Data World

Medpedia: a new source for medical information

2008-08-26T21:53:32.0012Z

Thanks for the information - I've passed this on to our data team to check it out!

Medpedia: a new source for medical information

2008-08-26T20:54:15.0018Z

which suppose to be both free, and accurate.

please consider this for a source for freebase when it launchs by the end of 2008.

SEC Board Members, Officers: updates?

2008-07-24T02:44:17.0017Z

Is this data source updated continuously or was it a one time upload?

Powerset: Merging these pages

2008-05-15T04:40:53.0012Z

Merge these pages... the three Powerset - Powerset, Inc. and PowerSet should be merged. They refer to the same entity

periodic wikipedia topic load: periodic update

2007-10-18T16:13:33.0012Z

way to go Al! you must've used the data from the in-house mirror since i don't see a newer enwiki data dump from wikipedia. glad it worked.

Wikipedia: wikipedia article length etc. as metric of importance of topic

2007-10-09T20:53:58.0000Z

Yes, inlinks are a simple and useful measure. Another which has received attention is number of edits. e.g. Wilkinson & Huberman, Assessing the value of cooperation in Wikipedia. Because Wikipedia is large and well-documented, and there's general interest in large graphs and the way they scale etc., there have been loads of measures made of it for various purposes - e.g. see Voss, Measuring Wikipedia, Buriol et al, Temporal Analysis of the Wikigraph, Chernov et al, Extracting Semantic Relationships between Wikipedia Categories, Ollivier et al, Finding Related Pages Using Green Measures: The Example of Wikipedia. (But this is no doubt telling my grandmother to suck eggs, since it's apparently not just that Microsoft is interested in leveraging wikipedia for named entity disambiguation, but also that you guys have some connection with Powerset!)

Wikipedia: wikipedia article length etc. as metric of importance of topic

2007-10-09T19:24:12.0007Z

Hi there. Interesting idea (and thanks for sharing). I'd like to point out that Wikipedia has standards that require long articles to be split into multiple shorter articles. So at least for the more edited and popular topics, the length of articles all approach the same over time. On the other hand, each time an article is split out, a link is added to the main article to it, so the number of links would be a better metric of article "importance", if such a thing can be considered in such absolute terms.

Wikipedia: wikipedia article length etc. as metric of importance of topic

2007-09-28T14:32:01.0000Z

Sure, using these things to do autocomplete/predictive disambiguation requires dynamic calculations with local context (Though they usually of course work with some static global measure as their background.) But global measures of 'overall importance' like length of a wikipedia page, or PageRank for a web page, do tell you something informative for some purposes. E.g., it would be interesting to be able to compare freebase coverage to that of wikipedia: which pages within a given wikipedia category or freebase type have quite a lot said about them in wikipedia but not much about them in freebase? which of two wikipedia categories has better coverage in freebase? Again, if an app goes to freebase to retrieve information which is visually displayed it need not use any importance metric to select the information it wants but could use the metric in the display (size of text in a tag cloud, size of circle in a map) etc.

Alumni load -- people connected to educational institutions: Which alumni have been loaded?

2007-09-27T18:51:06.0007Z

These came from wikipedia categories like "alumni of Cambridge University". I did it as an experiment to see if we could cover the more major universities. It's something we'll turn into a more automated pipeline soon, so that we can keep synchronized with wikipedia.

The hope is that if we at least get the institutions in, people will fill out the degrees and years over time.

Also, if you have other sources of this information, I'd be happy to load it. I find this kind of information to be really fun.

Wikipedia: wikipedia article length etc. as metric of importance of topic

2007-09-27T17:04:04.0000Z

That's a very interesting idea. We have an infrastructure internally that knows about the interconnectedness of wikipedia articles, it's part of the system that means that autocomplete and search know that "London" is more likely to be the one in England than the one in Ontario.

The issue with these metrics is that they are fairly dynamic and rather opaque and context sensitive. Different "George Bushes" are important if you are only interested in cricket rather than US politics for example. It's hard to get a single number which ranks "overall importance" in the same way that the web doesn't have a "most important page"; it all depends on what you are trying to do.

So I'm curious what applications you see as using this number (or set of data) and how they would use it.

Wikipedia: wikipedia article length etc. as metric of importance of topic

2007-09-21T17:10:20.0012Z

I'm reposting a comment I left at http://www.freebase.com/view/wikipedia, since no one seems to have noticed it there.

Lots of topics have keys in /wikipedia/en. I wonder whether it would be worth uploading, for each topic in this namespace, a simple measure of the relative importance of this topic in wikipedia. The simplest such measure would be the length of the wikipedia article (other obvious candidates: number of inlinks, number of outlinks, number of editors - even computation of the page's pagerank in the wikipedia graph, if the matrix computation was thought worth the effort.) This might allow more important topics to be selected for review to be given more attention: ceteris paribus, the more important a wikipedia topic, the more needs to be said about it on freebase. (I don't know if you have thought about metrics to measure how much is said about a topic in freebase.)

Alumni load -- people connected to educational institutions: Which alumni have been loaded?

2007-09-14T23:11:45.0005Z

The alumni load seems a great idea - there's a lot of nice specific data there. Casually browsing the Wikipedia category Alumni by university or college, though, I can't make out which alumni were loaded on Aug 24.

ISO 15924: Data load for Language Writing Systems?

2007-08-22T03:32:53.0005Z

It looks to me like this URL (http://unicode.org/iso15924/iso15924-codes.html) would be a good source for a data load for Language Writing Systems.

User Revert Operation For /user/mwcl_infobox: Removal of duplicate mwcl_infobox load

2007-08-05T17:54:15.0011Z

This revert operation was intended to fix a duplication protein dataset load that happened around June 11.

Musical track length uniqueness: 800K?

2007-06-20T07:54:16.0011Z

It looks more like you loaded 90K or less.

Hockey Roster Positions Loaded: ~8000 primitives

2007-04-23T06:09:36.0012Z

This looked more like 8000 primitives. We need a system to help predict how large a load is going to be. Maybe this is the sort of estimate that the data pusher could provide.