Brewster Kahle: what I think we’re missing out there are tools for context and citation

<iframe width=”560″ height=”315″ src=”https://www.youtube.com/embed/AU79zwAvKa0″ frameborder=”0″ allow=”accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture” allowfullscreen></iframe>
69:40
necessarily know about so Wikipedia is
69:45
still primarily created by Western young
69:49
male contributors they tell the story of
69:55
you know the worst knowledge from an
69:58
extremely limited and privileged
69:59
standpoint there are ridiculous gaps in
70:04
this knowledge and then skews what a my
70:07
favorite example is that there are
70:10
20,000 articles on French Wikipedia
70:13
about individual asteroids but a
70:15
language like Hausa that is spoken by 30
70:18
million people in Central Africa doesn’t
70:20
have an entry on the universe so if you
70:23
think that the the sum of all knowledge
70:26
representing Wikipedia and you look at
70:28
where it comes from and who created it
70:30
it’s ridiculously skewed and slanted
70:33
towards the demographic of the
70:35
contributors the problem with that is
70:37
not just with Wikipedia Wikipedia not
70:40
many people they know but the contents
70:43
get translated into our
70:45
d/f via a project like dbpedia they’re
70:49
then propagated to the rest of the
70:51
internet and basically every single
70:53
linked data system they used today what
70:57
is like a search engine for music or
70:59
biomedical information gets its entities
71:02
gets is like a fundamental relations
71:04
from Wikipedia so biasing by us out the
71:10
fact that is a small population of
71:12
contributors that are creating data and
71:16
information that powers the entire
71:18
ecosystem that AI relies upon I think
71:21
the fundamental problem that we all
71:22
should be worried about I’ve been very
encouraged by watching some of the
studies of how people use the web people
are very particular and very peculiar
nobody wakes up in the morning saying
hey I want to live a biased life or hey
I really want to go to the biased and
unfair news channel what I think we’re
missing out there are tools for context
and citation we’ve made it hard for
people to actually know what the hell
they’re looking at that we’ve made it so
that it’s really difficult to go and
understand is this some babble that just
has been bouncing around for a long time
and long discredited or is this um
something that actually is real and I
have trusted sources behind it
so I’m encouraged by people want to have
access to this stuff the Internet
Archive gets three four or five million
people a day coming and using its
72:24
service as best we can tell it’s about
72:26
the three hundredth most popular is is
72:29
about the first the fifth most popular
72:31
okay I’m a little envious um but it does
72:34
indicate that there’s a lot of interest
72:37
in finding deeper information than it’s
72:41
casually available so people want it
72:44
that’s the good news
72:46
now we need to build some of the tools I
72:48
would suggest for citation for context
72:51
and embed it and that’s what this whole
72:53
conference is about I’m really glad to
72:55
be here
72:57
sorry one last note on context I think
72:59
you’ve gotten to the heart of a really
73:01
really big problem which we missed out
73:02
on the entire problem of knowledge
73:05
production is about context not just
73:07
merely switching from one platform to
73:09
another but you know to take a perhaps a
73:12
banal example at a researcher who read a
73:17
paper of a lab that performed a set of
73:21
experimental conditions that requires a
73:24
context change for if you are working on
73:27
a different organism if even if you’re
73:29
trying to validate and reproduce those
73:30
results that is a context change which
73:32
requires translations so big new big
73:35
problem we should definitely work on
73:37
this I think with that we will wrap it
73:41
up and just want to say thanks to the
73:43
panelists and for coming up here and
73:45
sharing
73:47
[Applause]

Money and Debt and Digital Contracts – Brewster Kahle at Devcon 5

The dreams of cryptocurrencies tend to focus on money and seem to avoid the topic, repercussions, and significance of debt. In fiat currencies, 95% of all money is matched with debt — in other words, debt creates 95% of all money. This talk aims to bring the impact of debt into the Ethereum conversation, specifically focusing on debt with interest. Let’s consider this side of crypto coins and Ethereum in particular since it provides the ability to encode obligations as contracts and therefore can encode debt obligations.

Internet Archive Fends Off Secret FBI Order in Latest Victory Against NSLs Dec. 2, 2016

A decade ago, the FBI sent Brewster Kahle, founder of the Internet Archive, a now-infamous type of subpoena known as a National Security Letter, demanding the name, address and activity record of a registered Internet Archive user. The letter came with an everlasting gag order, barring Kahle from discussing the order with anyone but his attorney — not even his wife could know.

The Internet Archive Is Making Wikipedia More Reliable

The operator of the Wayback Machine allows Wikipedia’s users to check citations from books as well as the web.

Wikipedia is the arbiter of truth on the internet. It’s what settles arguments at bars. It supplies answers for the information snippets you see on your Google or Bing search results. It’s the first stop for nearly everyone doing online research.

The reason people rely on Wikipedia, despite its imperfections, is that every claim is supposed to have citations. Any sentence that isn’t backed up with a credible source risks being slapped with the dreaded “citation needed” label. Anyone can check out those citations to learn more about a subject, or verify that those sources actually say what a particular Wikipedia entry claims they do—that is, if you can find those sources.

It’s easy enough when the sources are online. But many Wikipedia articles rely on good old-fashioned books. The entry on Martin Luther King Jr., for example, cites 66 different books. Until recently, if you wanted to verify that those books say what the article says they say, or if you just wanted to read the cited material, you’d need to track down a copy of the book.

Now, thanks to a new initiative by the Internet Archive, you can click the name of the book and see a two-page preview of the cited work, so long as the citation specifies a page number. You can also borrow a digital copy of the book, so long as no else has checked it out, for two weeks—much the same way you’d borrow a book from your local library. (Some groups of authors and publishers have challenged the archive’s practice of allowing users to borrow unauthorized scanned books. The Internet Archive says it seeks to widen access to books in “balanced and respectful ways.”)

So far the Internet Archive has turned 130,000 references in Wikipedia entries in various languages into direct links to 50,000 books that the organization has scanned and made available to the public. The organization eventually hopes to allow users to view and borrow every book cited by Wikipedia, with the ultimate goal being to digitize every book ever published.

“Our goal is to be a library that’s useful and reachable by more people,” says Mark Graham, director of the Internet Archive’s Wayback Machine service.

If successful, the Internet Archive’s project would be a boon to students, journalists, or anyone who wants to check the references of a Wikipedia entry. Google Books also has a massive collection of digitized print books, but it tends to only show small snippets of a text.

“I’ve tried to verify Wikipedia pages by searching blurbs in Google Books but it’s an unpredictable link, and you often don’t have enough surrounding context to evaluate the use,” says Mike Caulfield, a digital literacy expert and director of blended and networked learning at Washington State University Vancouver. “The ability to read a page or two of context around a quote is crucial to both editors trying to protect the integrity of articles, and to readers who need to get to that next step of verification.”

You could, of course, verify the information the traditional way by tracking down a physical copy of a book. But students working late into the night on term papers, or reporters on tight deadlines, might not have time to order a book on Amazon or wait for a library book to become available. In other cases, books might be hard to come by. The Wikipedia entry on the internment of Japanese-Americans during World War II, for example, cites hard-to-find titles, says Internet Archive director of partnerships Wendy Hanamura. But thanks to the Internet Archive’s Digital Library of Japanese-American Incarceration, created with the Seattle-based organization Densho, many of those rare books are now available online.

The Internet Archive embarked on its effort to weave digital books into Wikipedia after the 2016 election. “No matter who you wanted to be president, I would say almost everyone would agree the whole process was a train wreck,” Internet Archive founder Brewster Kahle said in a speech in San Francisco last week. From fake news and inauthentic social media campaigns waged by foreign nations to concerns about voting systems themselves being rigged, there were plenty of ways that technology and information systems failed the public. So Kahle convened a group of people to discuss how to improve the information ecosystem. One issue that came up was the fragility of Wikipedia citations. Books and academic journals supply some of the best, most reliable information for Wikipedia editors, but those sources frequently are either unavailable online or are behind paywalls. And even freely available internet content often disappears.

The Internet Archive was in a unique position to help solve this problem. The organization’s Wayback Machine service has archived 387 billion webpages since 2001. It’s also been digitizing physical books and other analog media, and has now scanned 3.8 million books. It has millions more books warehoused.

Graham and company created the InternetArchiveBot, a tool that scans Wikipedia for broken links and automatically adds links to versions archived in the Wayback Machine. Because automatic editing tools require special permission to use, Graham has to work with the Wikipedia communities that manage versions of the encyclopedia in different languages. “All told, we’ve edited 14 million links; more than 11 million point to Internet Archive,” he says.

Adding links to books is similar but more challenging. “If a book has an ISBN number and an entry has a traditional citation format, it’s pretty easy,” Graham explains. But not all books have ISBN numbers, and many Wikipedia citations aren’t properly formatted. For instance, some only cite the book and not a specific page number. There can also be differences between different editions of a book.

Of course, the Internet Archive hasn’t scanned all the books cited by Wikipedia yet. It’s working hard to digitize collections from libraries around the world, along with donations from companies like Better World Books. Graham says the organization scans more than 1,000 books per day. But it has plenty more work to do.