WebSearches Source-led research on search and discovery

Latest research

Newest 25 articles. Each preview is capped for scanning; open the article for the full source trail.

Search & DiscoveryJuly 18, 202613 min

The Recall Architect How Dr. Susan Leavy Built a Framework for Measuring Search Engine Truthfulness

An Irish AI researcher who began detecting bias in political news has quietly shaped how governments and institutions think about what search engines owe their users.

We assume search engines simply return information; the reality, however, is they actively *shape* it. Dr. Susan Leavy spent years building systems to understand how information is prioritized - first on financial trading floors, then in academic research. This unlikely journey led her to a groundbreaking question: can we actually measure the “truthfulness” of a search engine's results, and build a framework to ensure more reliable information access? She was studying bias in political news coverage training...

Search & DiscoveryJuly 15, 202610 min

The Textbook That Defined How We Teach Machines to Find Information

How Ricardo Baeza-Yates and Berthier Ribeiro-Neto built a rigorous computer-science framework for information retrieval that still shapes search technology today.

There is a moment, frozen in the late pages of a book that helped teach an entire generation how to build search engines. The cover shows a simple line drawing a hand reaching toward a globe, fingers almost touching. It is 1999, and the World Wide Web is still young enough that most people access it through dial-up modems, still chaotic enough that nobody quite knows how to organize it. In Santiago, Chile, and Belo Horizonte, Brazil, two computer scientists have just finished a book that will become one of the...

Search & DiscoveryJuly 13, 202610 min

Edinburgh lab's Scrapy powers academic search worldwide

From a Glasgow computing lab in 2004, a team of researchers set out to build a search engine that could handle the world's largest document collections and ended up creating the platform that researchers worldwide still rely on today.

## The Lab Where Search Was Taken Seriously In a computing science department on the banks of the River Clyde, a group of researchers decided that searching large document collections shouldn't require proprietary software or massive institutional budgets. Around 2004, members of the Information Retrieval Research Group at the University of Glasgow began building what would become one of academic search's most enduring open-source tools and they named it with characteristic Scottish humor. Terrier. As in terabyte...

Search & DiscoveryJuly 10, 202610 min

How citation networks are rebuilding academic discovery

A new wave of academic search tools is turning the traditional keyword search inside out following the invisible threads between papers instead of just the words inside them.

Citation networks are replacing keyword searches to fundamentally improve how researchers discover foundational academic work. By mapping the relationships between papers rather than relying on isolated terms, these networks prevent critical research from being buried by search algorithms. This is not a failure of effort. It is a structural limitation of how most academic search works and a small group of researchers have decided to fix it. The Map Behind the Paper A citation network is, at its core, a visual map...

Search & DiscoveryJuly 10, 20268 min

How the Allen Institute Is Rebuilding Academic Search From the Researcher's Mind

An AI research institute founded by Paul Allen has quietly built two tools that rethink how scholars find, compare, and synthesize scientific literature without keyword guesswork or citation dead ends.

The Search That Never Fit the Researcher For decades, academic search has asked researchers to do something counterintuitive: reduce complex questions into a handful of keywords, then scroll through results that may or may not match what you actually meant. You craft a query, scan a list, rephrase, scan again, follow a citation, get lost in related work that turns out to be tangential, and start over. The process works, sort of, but it demands the researcher bend their thinking to match the tool more than the...

Search & DiscoveryJuly 1, 20268 min

Quora's truth arbiter Anant Shar's quality framework revealed

This article explores the intersection of answer quality engineering and truth-decision frameworks at Quora, drawing from available public materials and documented practitioner approaches.

The Question Behind the Question Somewhere in the vast machinery of how knowledge gets organized online, someone has to decide what counts as true. Not in the philosophical abstract philosophers have been doing that for millennia but in the practical, everyday sense of whether an answer to a question is good enough to show to someone who asked. This is the work that sits at the heart of answer engines, and it is harder than it looks. The term "answer quality engineer" sounds almost clinical, like something from a...

Search & DiscoveryJune 28, 202612 min

Inverted index the tech powering Google's search dominance

Tracing the quiet intellectual journey from library card catalogs to Google, through the data structure that still powers every search engine you use today.

Everyone assumes Google's search dominance comes from some impossibly complex algorithm, a secret sauce of artificial intelligence. But the foundation of its speed and power isn't cutting-edge AI at all it's a surprisingly straightforward data structure called the inverted index. This technique doesn't focus on analyzing documents, but rather on flipping the search problem entirely: instead of finding documents *by* their content, it finds them *through* their words. This insight that inversion is the key to speed...

Search & DiscoveryJune 26, 202610 min

The Man Who Taught Computers to Read Between the Lines

How Gerard Salton's Cornell research team built a mathematical framework for understanding text that still powers every search engine you use today.

We often assume the information age began with the internet, but a crisis of knowledge overwhelmed us decades earlier. Even as scientific publishing boomed after World War II, the tools meant to organize it - libraries and their card catalogs - were failing spectacularly. Researchers weren't lacking information, they were drowning in it, hampered by inconsistent indexing and the limitations of keyword searches. This pre-digital deluge sparked a surprisingly modern quest: to teach computers to *understand* what we...

Search & DiscoveryJune 25, 20268 min

The Relevance Engineer From Academic IR Labs to Modern Search Products

The discipline that emerged when search engines stopped matching strings and started understanding meaning now shapes whether your content gets retrieved or buried inside AI-generated answers.

There is a moment in every university information retrieval lab when a researcher realizes that the system they have spent months tuning is solving the wrong problem. The queries that real people type into search bars do not arrive clean and precise. They arrive messy, ambiguous, underspecified fragments of a thought, half a phrase, sometimes just a name spoken aloud and transcribed by accident. The researcher learns to build for this chaos, not against it. That same sensibility building for how people actually...

Search & DiscoveryJune 22, 202612 min

The Patent Decoder Bill Slawski's Twenty-Year Journey Mapping Google's Hidden Logic

For two decades, Bill Slawski turned dense Google patent filings into the intellectual foundation that serious SEO practitioners still work from today.

There is a particular kind of reader who, when handed a 50-page patent filing dense with technical language and legal boilerplate, sees not a wall but a window. Bill Slawski was that reader. For more than twenty years, he sat with documents that most people in the search industry would have scrolled past, and he pulled meaning from them not to win arguments or chase algorithm rumors, but to understand. To map, as he once put it, what Google was actually building beneath the surface of its public statements....

Technology & AIJune 20, 202611 min

The Long Road to Margaret Thatcher's Britain Paul Graham's 1983 Photo Book Returns

How a photographer's journey along Britain's oldest thoroughfare became an accidental portrait of a nation in transformation.

There is a photograph in Paul Graham's book A1: The Great North Road that tells more about Britain in the early 1980s than any policy paper or political speech. Two men in business attire stand against the creamy white stone of the Bank of England in the City of London. One, dressed in a blue suit, smiles broadly as he holds a piece of notepaper toward his younger companion, who wears navy-blue pinstripes and an equally broad grin. The bright-blue necktie of the older man is flopped over his raised arm, its hue...

Technology & AIJune 18, 202612 min

Les Grenadiers and the Quiet Revolution of Haitian Pride

For the first time since 1974, Haiti's national soccer team has qualified for the World Cup and in doing so, it has carried something far larger than a bid for sporting glory into the arena.

The Weight of a Single Goal On the night of November 18, 2025, Louicius Deedson sliced through Nicaragua's defense and buried the winning strike that had eluded Haiti for more than five decades. The goal, scored in the dying moments of the World Cup qualifiers, sent a nation and its far-flung diaspora into a collective release that had been building for generations. That date carried additional resonance: it fell exactly 222 years after Jean-Jacques Dessalines fought his famous battle against French forces on the...

Editorial ResearchJune 15, 202610 min

The Answer Engine Revolution How Search Became a Threat to Publishers

Search engines are no longer just pointing you toward information they're answering questions themselves, and the shift is remaking how content gets found, valued, and attributed across the web.

Late last year, a journalist at a digital media outlet noticed something peculiar in her analytics. A well-researched explainer article the kind of piece her publication had built its reputation on was showing up in search results. The snippet looked accurate. The key facts were there. But the traffic was nearly gone. Someone searching for that information was getting everything they needed right on the search results page. The link existed. The visit never happened. This is not a hypothetical future scenario. It...

Health & BehaviorJune 14, 20269 min

The Crown That Cost $1,500 Why Dental Insurance Leaves a Gap Most Patients Don't Expect

A retired Nashville man paid about $2,000 for dental care last year despite having insurance. Here's what the numbers actually mean, and what you can do about it.

Russell Anthony made eight trips to the dentist last year. The 65-year-old retiree in Nashville, Tennessee, hopes to go less often in 2026, but he's already made a few visits. "I had a root canal just last week that was like $500," he said. "The week before that, I had a crown that cost me several hundred dollars. And as we speak, I have a broken tooth, and I have to go and see the dentist soon." In all, Anthony expects to pay about $2,000 for dental care this year, even though he has dental insurance. His...