You are currently browsing the monthly archive for July 2009.
My two-volume book, “Poincaré’s legacies: pages from year two of a mathematical blog“, which was based on the 2008 posts of this blog, has now been published by the American Mathematical Society.
[Update, Aug 3: Actually, only the first volume has been published so far. The second volume of this book will be available on Aug 10.]
The mini-polymath project to find solutions to Problem 6 of the 2009 IMO is still ongoing, but I thought that, while the memories of the experience are still fresh, it would be a good time to open a parallel thread to collect the impressions that participants and observers had of how the project was conducted, how successful it was, and how it (or future projects) could be made to run more smoothly.
Just to get the ball rolling, here are some impressions I got as a (rather passive) moderator:
- There is no shortage of potential interest in polymath projects. I was impressed by how the project could round up a dozen interested and qualified participants in a matter of hours; this is one particular strength of the polymath paradigm. Of course, it helped that this particular project was elementary, and was guaranteed to have an elementary (and relatively short) solution. Nevertheless, the availability of volunteers does bode well for future projects of this type.
- A wiki needs to be set up as soon as possible. The wiki for polymath1 was an enormously valuable resource, once it was set up. I had naively thought that the mini-polymath1 project would be short enough that a wiki was not necessary, but now I see that it would have come in handy for organising and storing the arguments, strategies, insights, and ideas that arose through the linear blog thread format, but which was difficult to summarise in that format. (I have belatedly set a wiki for this project up here.) For the next polymath project (I have none planned yet, but can imagine that one would eventually arise), I will try to ensure a wiki is available early on.
- There is an increasing temptation to work offline as the project develops. In the rules of the polymath projects to date, the idea is for participants to avoid working “offline” for too long, instead reporting all partial progress and thoughts on the blog and/or the wiki as it occurs. This ideal seems to be adhered to well in the first phases of the project, when the “easy” but essential observations are being made, and the various “low-hanging fruits” are harvested, but at some point it seems that one needs to do more non-trivial amounts of computation and thought, which is still much easier to do offline than online. It is possible that future technological advances (e.g. the concurrent editing capabilities of platforms such as Google Wave) may change this, though; also a culture and etiquette of collaborative thinking might also evolve over time, much as how mathematical research has already adapted to happily absorb new modes of communication, such as email. In the meantime, though, I think one has accommodate both online and offline modes of thinking to make a polymath project as successful as possible, avoiding degeneration into a mass of low-quality observations on one hand, and a fracturing into isolated research efforts on the other.
- Without leadership or organisation, the big picture can be obscured by chaos. As I was distracted by other tasks (for instance, flying from Bremen back to Los Angeles), and had already known of a solution to the problem, I adopted a laissez faire attitude to task of moderating the project. This worked to some extent, and there was certainly no shortage of ideas being tossed back and forth, arguments being checked and repaired, etc., but I think that with more active moderation, one could have had a bit more focus on longer-term strategy and vision than there was. Perhaps in future projects one could be more explicit in the rules about encouraging this sort of perspective (for instance, in encouraging periodic summaries of the situation either on the blog or on the wiki).
- Polymath projects tend to generate multiple solutions to a problem, rather than a single solution. A single researcher will tend to focus on only one idea at a time, and is thus generally led to just a single solution (if that idea ends up being successful); but a polymath project is more capable of pursuing several independent lines of attack simultaneously, and so often when the breakthrough comes, one gets multiple solutions as a result. This makes it harder to do direct comparison of success between polymath projects and individual efforts; from the (limited) data points available, I tentatively hypothesise that polymath projects tend to be slower, but obtain broader and deeper results, than what a dedicated individual effort would accomplish.
- Polymath progress is both very fast and very slow. I’ve noticed something paradoxical about these projects. On the one hand, progress can be very fast in the sense that ideas get tossed out there at a rapid rate; also, with all the proofreaders, errors in arguments get picked up much quicker than when only one mathematician is involved. On the other hand, it can take a while for an idea or insight obtained by one participant to be fully absorbed by the others, and sometimes the key observation can be drowned out by a large number of less important observations. The process seems somewhat analogous to that of evolution and natural selection in biology; consider for instance how the meme of “try using induction”, which was the ultimately successful approach, had to first fight among competing memes such as “try using contradiction”, “try counting arguments”, “try topological arguments on the cube”, etc., before gaining widespread acceptance. In contrast, an individual might through luck (or experience) hit upon the right approach (in this case, induction) very early on and end up with a solution far quicker than a polymath effort; conversely, he or she may select the wrong approach and end up wasting far more time than a polymath would.
- The wordpress blog format is adequate, but far from ideal. Technical problems (most notably, the spam filter, the inability to preview or edit comments [except by myself], and the (temporary) lack of nesting and automatic comment numbering) made things more frustrating and clunky than they should be. Adding the wiki helps some of the problems, but definitely not all, especially since there is no integration between the blog and the wiki. But the LaTeX support included in the WordPress blog is valuable, even if it does act up sometimes. Hopefully future technologies will provide better platforms for this sort of thing. (As a temporary fix, one might set up some dedicated blog (or other forum) for polymath projects with customised code, rather than relying on hosts.)
<swolpert@support.ucla.edu>
Well, participation in the IMO 2009 Q6 polymath project has exceeded my expectations; it appears that the collaborative effort has scored some partial successes toward a solution in the first 24 hours of its existence, but is not quite there yet.
As the thread has become overly long, I am following established polymath practice and starting a new thread here, hopefully to try to impose more order onto the chaos. In order to assist this effort, some of the participants may wish to summarise some of the “state of play” so far. (I am unable to do this due to being biased by the knowledge of a solution.)
The comment numbering system has not worked as smoothly as I had hoped, but it is still better than nothing. I propose that comments in this thread start at 200, so as not to collide with the previous thread.
Of course, all the rules of the polymath exercise (as discussed in the previous thread) continue to apply. I am pleased to see that virtually everyone participating has adhered to the collaborative spirit of the exercise, for instance in keeping criticism constructive and technical rather than pejorative and personal.
As an experiment, I have enabled one level of comment threading; thus one can reply to a specific comment in the thread below. If one does so, I would request that you number the comment by subsection, for instance the first response to comment 234 would be numbered 234.1, the next one 234.2, and so forth. There is a tradeoff here; the threading adds more structure to the comments, but the flip side of this is that it makes it harder to read off at a glance all the comments made since the last time one checks the thread. Hopefully participants will be able to use their discretion when to reply and when not to. [Update, Jul 21: Threading should work properly now, I didn’t set it properly before.]
The International Mathematical Olympiad (IMO) consists of a set of six problems, to be solved in two sessions of four and a half hours each. Traditionally, the last problem (Problem 6) is significantly harder than the others. Problem 6 of the 2009 IMO, which was given out last Wednesday, reads as follows:
Problem 6. Let
be distinct positive integers and let
be a set of
positive integers not containing
. A grasshopper is to jump along the real axis, starting at the point
and making
jumps to the right with lengths
in some order. Prove that the order can be chosen in such a way that the grasshopper never lands on any point in
Of the 500-odd participants in the Olympiad, only a half-dozen or so managed to solve this problem completely (I don’t have precise statistics yet). I myself worked it out about seven hours after first hearing about the problem, though I was preoccupied with other things for most of that time period.
I thought that this problem might make a nice “mini-Polymath” project to be solved collaboratively; it is significantly simpler than an unsolved research problem (in particular, being an IMO problem, it is already known that there is a solution, which uses only elementary methods), and the problem is receptive to the incremental, one-trivial-observation-at-a-time polymath approach. So I would like to invite people to try solving the problem collaboratively on this blog, by posting one’s own comments, thoughts, and partial progress on the problem here.
To keep with the spirit of the polymath approach, I would however like to impose some ground rules:
- Everyone who does not already know the solution, and has not worked on the problem already, is welcome to jump in and participate, regardless of mathematical level.
- However, in order not to spoil the experiment, I would ask that those of you who have already found a solution not to give any hint of the solution here until after the collaborative effort has found its solution. (At that point, everyone is welcome to give out their solutions here.) For instance, I will not be participating in the project except as a moderator.
- For similar reasons, I would ask that competitors at the actual 2009 IMO refrain from commenting substantively on the problem on this thread until after the collaborative effort has succeeded. (I know this may require some significant restraint, but I suspect the problem will become too easy if we get comments along the lines of “This was a tough problem! I tried X and Y and Z, and they didn’t work; I tried W also but ran out of time. I hear that someone solved the problem using U, though.” Of course, after the collaborative effort has succeeded, you are more than welcome to share your own experiences with the problem.)
- Participants should avoid explicitly searching for solutions to this problem on the internet (I would imagine spoilers would become available in a few days). If you do accidentally find such a solution online, I would ask that you recuse yourself from the rest of the collaboration, until after they have found a solution also. (In particular, posting links to a solution is strongly discouraged until after the collaborative effort has succeeded.)
- In a similar vein, extensive searching of the mathematical literature should only be undertaken if there is a consensus to do so on this thread.
- Participants are also discouraged from working too hard on this problem “offline”; if you have a potentially useful observation, one should share it with the other collaborators here, rather than develop it further in private, unless it is “obvious” how to carry the observation further.
- Actually, even “frivolous” observations can (and should) be posted on this thread, if there is even a small chance that some other participant may be able to find it helpful for solving the problem.
- Similarly, “failed” attempts at a solution are also worth posting; another participant may be able to salvage the argument, or else the failure can be used as a data point to eliminate some approaches to the problem, and to isolate more promising ones.
- Participants should view themselves as contributing to a team effort, rather than competing with each other (in contrast to the actual IMO). The point is not to obtain bragging rights for being the first or quickest to solve the problem (which has, after all, already been solved), but instead to experimentally test the hypothesis that a mathematical problem can be solved by a massive collaboration, without requiring serious effort on behalf of any one of the participants. (See Tim Gowers’ essay “is massively collaborative mathematics possible?” for more discussion.)
- To make it easier to reference comments in this thread, I would ask commenters to number their comments (so that the first comment be labeled 1., the second comment be labeled 2., and so forth.)
- Unlike the actual IMO, there is no artificial time limit on this exercise, though if there is insufficient participation, or the collaborative effort grinds to a halt, I may at my discretion close the experiment and give out solutions after a reasonable time period.
This week I am in Bremen, where the 50th International Mathematical Olympiad is being held. A number of former Olympians (Béla Bollobás, Tim Gowers, Laci Lovasz, Stas Smirnov, Jean-Christophe Yoccoz, and myself) were invited to give a short talk (20 minutes in length) at the celebratory event for this anniversary. I chose to talk on a topic I have spoken about several times before, on “Structure and randomness in the prime numbers“. Given the time constraints, there was a limit as to how much substance I could put into the talk; but I try to describe, in very general terms, what we know about the primes, and what we suspect to be true, but cannot yet establish. As I have mentioned in previous talks, the key problem is that we suspect the distribution of the primes to obey no significant patterns (other than “local” structure, such as having a strong tendency to be odd (which is local information at the 2 place), or obeying the prime number theorem (which is local information at the infinity place)), but we still do not have fully satisfactory tools for establishing the absence of a pattern. (This is in contrast with many types of Olympiad problems, where the key to solving a problem often lies in discovering the right pattern or structure in the problem to exploit.)
The PDF of the talk is here; I decided to try out the Beamer LaTeX package for a change.
Seven videotaped lectures from 1964 by Richard Feynman given in Cornell, on “The Character of Physical Law“, have recently been put online (by Microsoft Research, through the purchase of these lectures from the Feynman estate by Bill Gates, as described in this interview with Gates), with a number of multimedia enhancements (external links, subtitles, etc.). These lectures, intended for a general audience, broadly cover the same type of material that is in his famous lectures on physics.
I have just finished the first lecture, describing the history and impact of the law of gravitation as a model example of a physical law; I had of course known of Feynman’s reputation as an outstandingly clear, passionate, and entertaining lecturer, but it is quite something else to see that lecturing style directly. The lectures are each about an hour long, but I recommend setting aside the time to view at least one of them, both for the substance of the lecture and for the presentation. His introduction to the first lecture is surprisingly poetic:
The artists of the Renaissance said that man’s main concern should be for man.
And yet, there are some other things of interest in this world: even the artist appreciates sunsets, and ocean waves, and the march of the stars across the heavens.
And there is some reason, then, to talk of other things sometimes.
As we look into these things, we get an aesthetic pleasure directly on observation, but there’s also a rhythm and pattern between the phenomena of nature, which isn’t apparent to the eye, but only to the eye of analysis.
And it’s these rhythms and patterns that we call physical laws.
What I want to talk about in this series of lectures is the general characteristics of these physical laws. …
The talk then shifts to the very concrete and specific topic of gravitation, though, as can be seen in this portion of the video:
Coincidentally, I covered some of the material in Feynman’s first lecture in my own talk on the cosmic distance ladder, though I was approaching the topic from a rather different angle, and with a less elegant presentation.
[Via the New York Times. Note that some browsers may need a Silverlight extension in order to view the videos. Youtube versions of three of the seven lectures are available here. Another, much more recent, series of videotaped lectures of Feynman is available here.]
[Update, July 15: Of particular interest to mathematicians is his second lecture “The relation of mathematics and physics”. He draws several important contrasts between the reasoning of physics and the axiomatic reasoning of formal, settled mathematics, of the type found in textbooks; but it is quite striking to me that the reasoning of unsettled mathematics – recent fields in which the precise axioms and theoretical framework has not yet been fully formalised and standardised – matches Feynman’s description of physical reasoning in many ways. I suspect that Feynman’s impressions of mathematics as performed by mathematicians in 1964 may differ a little from the way mathematics is performed today.]
The Riemann zeta function 
and then continued meromorphically to other values of 
(for 
where 
and differentiating the above identity in
where 
for real 
and thus we see that 
Inverting the Fourier transform (or performing a contour integral closely related to the inverse Fourier transform), one is led to the prime number theorem
In fact, the standard proof of the prime number theorem basically proceeds by making all of the above formal arguments precise and rigorous.
Unfortunately, we don’t know as much about the zeroes 
Nevertheless, we do know some reasonably non-trivial facts about the zeroes
is non-negative for 
(which can be viewed as a consequence of the Poisson summation formula, see e.g. my blog post on this topic) we know that there are no zeroes for 
We also know that there are infinitely many non-trivial zeroes, and can approximately count how many zeroes there are in any large bounded region of the critical strip. For instance, for large 
Another thing that we happen to know is how the magnitude 
Theorem 1 Let
(say). Then the distribution of
converges (in distribution) to the normal distribution
.
To put it more informally, 
Remarkably, Selberg’s result does not need RH or GUE, though it is certainly consistent with such hypotheses. (For instance, the determinant of a GUE matrix asymptotically obeys a remarkably similar log-normal law to that given by Selberg’s theorem.) Indeed, the net effect of these hypotheses only affects some error terms in 
Selberg never actually published the above result, but it is reproduced in a number of places (e.g. in this book by Joyner, or this book by Laurincikas). As with many other results in analytic number theory, the actual details of the proof can get somewhat technical; but I would like to record here (partly for my own benefit) an informal sketch of some of the main ideas in the argument.
This is a continuation of the preceding two threads here on the polymath1 project, which are now full. We are closing on on the computation of the sixth Moser number – the size of the largest subset of the six-dimensional cube 
Besides this, the nominal purpose of this thread is to coordinate the writing of the second paper of the project. In addition to incorporating whatever results we get from the six-dimensional Moser problem, a lot of work still has to be done on other sections of the paper, notably the higher k component and the component on Fujimura’s problem, as well as the appendices.
A remarkable phenomenon in probability theory is that of universality – that many seemingly unrelated probability distributions, which ostensibly involve large numbers of unknown parameters, can end up converging to a universal law that may only depend on a small handful of parameters. One of the most famous examples of the universality phenomenon is the central limit theorem; another rich source of examples comes from random matrix theory, which is one of the areas of my own research.
Analogous universality phenomena also show up in empirical distributions – the distributions of a statistic 
- (i) take values as positive numbers;
- (ii) range over many different orders of magnitude;
- (iiii) arise from a complicated combination of largely independent factors (with different samples of
- (iv) have not been artificially rounded, truncated, or otherwise constrained in size.
Examples here include the population of countries or cities, the frequency of occurrence of words in a language, the mass of astronomical objects, or the net worth of individuals or corporations. The laws are then as follows:
- Benford’s law: For
, the proportion of
is approximately
. Thus, for instance,
of the time, but a first digit of
only about
of the time.
- Zipf’s law: The
largest value of
for the first few
and some parameters
. In many cases,
is close to
- Pareto distribution: The proportion of
digits (before the decimal point), where
for some
. Again, in many cases
Benford’s law and Pareto distribution are stated here for base 
To illustrate these laws, let us take as a data set the populations of 235 countries and regions of the world in 2007 (using the CIA world factbook); I have put the raw data here. This is a relatively small sample (cf. my previous post), but is already enough to discern these laws in action. For instance, here is how the data set tracks with Benford’s law (rounded to three significant figures):
| |
Countries | Number | Benford prediction |
| 1 | Angola, Anguilla, Aruba, Bangladesh, Belgium, Botswana, Brazil, Burkina Faso, Cambodia, Cameroon, Chad, Chile, China, Christmas Island, Cook Islands, Cuba, Czech Republic, Ecuador, Estonia, Gabon, (The) Gambia, Greece, Guam, Guatemala, Guinea-Bissau, India, Japan, Kazakhstan, Kiribati, Malawi, Mali, Mauritius, Mexico, (Federated States of) Micronesia, Nauru, Netherlands, Niger, Nigeria, Niue, Pakistan, Portugal, Russia, Rwanda, Saint Lucia, Saint Vincent and the Grenadines, Senegal, Serbia, Swaziland, Syria, Timor-Leste (East-Timor), Tokelau, Tonga, Trinidad and Tobago, Tunisia, Tuvalu, (U.S.) Virgin Islands, Wallis and Futuna, Zambia, Zimbabwe | 59 ( ) |
71 ( ) |
| 2 | Armenia, Australia, Barbados, British Virgin Islands, Cote d’Ivoire, French Polynesia, Ghana, Gibraltar, Indonesia, Iraq, Jamaica, (North) Korea, Kosovo, Kuwait, Latvia, Lesotho, Macedonia, Madagascar, Malaysia, Mayotte, Mongolia, Mozambique, Namibia, Nepal, Netherlands Antilles, New Caledonia Norfolk Island, Palau, Peru, Romania, Saint Martin, Samoa, San Marino, Sao Tome and Principe, Saudi Arabia, Slovenia, Sri Lanka, Svalbard, Taiwan, Turks and Caicos Islands, Uzbekistan, Vanuatu, Venezuela, Yemen | 44 ( ) |
41 ( ) |
| 3 | Afghanistan, Albania, Algeria, (The) Bahamas, Belize, Brunei, Canada, (Rep. of the) Congo, Falkland Islands (Islas Malvinas), Iceland, Kenya, Lebanon, Liberia, Liechtenstein, Lithuania, Maldives, Mauritania, Monaco, Morocco, Oman, (Occupied) Palestinian Territory, Panama, Poland, Puerto Rico, Saint Kitts and Nevis, Uganda, United States of America, Uruguay, Western Sahara | 29 ( ) |
29 ( ) |
| 4 | Argentina, Bosnia and Herzegovina, Burma (Myanmar), Cape Verde, Cayman Islands, Central African Republic, Colombia, Costa Rica, Croatia, Faroe Islands, Georgia, Ireland, (South) Korea, Luxembourg, Malta, Moldova, New Zealand, Norway, Pitcairn Islands, Singapore, South Africa, Spain, Sudan, Suriname, Tanzania, Ukraine, United Arab Emirates | 27 ( ) |
22 ( ) |
| 5 | (Macao SAR) China, Cocos Islands, Denmark, Djibouti, Eritrea, Finland, Greenland, Italy, Kyrgyzstan, Montserrat, Nicaragua, Papua New Guinea, Slovakia, Solomon Islands, Togo, Turkmenistan | 16 ( ) |
19 ( ) |
| 6 | American Samoa, Bermuda, Bhutan, (Dem. Rep. of the) Congo, Equatorial Guinea, France, Guernsey, Iran, Jordan, Laos, Libya, Marshall Islands, Montenegro, Paraguay, Sierra Leone, Thailand, United Kingdom | 17 ( ) |
16 ( ) |
| 7 | Bahrain, Bulgaria, (Hong Kong SAR) China, Comoros, Cyprus, Dominica, El Salvador, Guyana, Honduras, Israel, (Isle of) Man, Saint Barthelemy, Saint Helena, Saint Pierre and Miquelon, Switzerland, Tajikistan, Turkey | 17 () |
14 ( ) |
| 8 | Andorra, Antigua and Barbuda, Austria, Azerbaijan, Benin, Burundi, Egypt, Ethiopia, Germany, Haiti, Holy See (Vatican City), Northern Mariana Islands, Qatar, Seychelles, Vietnam | 15 ( ) |
12 ( ) |
| 9 | Belarus, Bolivia, Dominican Republic, Fiji, Grenada, Guinea, Hungary, Jersey, Philippines, Somalia, Sweden | 11 ( ) |
11 ( ) |
Here is how the same data tracks Zipf’s law for the first twenty values of 
| |
Country | Population | Zipf prediction | Deviation from prediction |
| 1 | China | 1,330,000,000 | 1,280,000,000 |  |
| 2 | India | 1,150,000,000 | 626,000,000 |  |
| 3 | USA | 304,000,000 | 412,000,000 |  |
| 4 | Indonesia | 238,000,000 | 307,000,000 |  |
| 5 | Brazil | 196,000,000 | 244,000,000 |  |
| 6 | Pakistan | 173,000,000 | 202,000,000 |  |
| 7 | Bangladesh | 154,000,000 | 172,000,000 |  |
| 8 | Nigeria | 146,000,000 | 150,000,000 |  |
| 9 | Russia | 141,000,000 | 133,000,000 |  |
| 10 | Japan | 128,000,000 | 120,000,000 |  |
| 11 | Mexico | 110,000,000 | 108,000,000 |  |
| 12 | Philippines | 96,100,000 | 98,900,000 |  |
| 13 | Vietnam | 86,100,000 | 91,100,000 |  |
| 14 | Ethiopia | 82,600,000 | 84,400,000 |  |
| 15 | Germany | 82,400,000 | 78,600,000 |  |
| 16 | Egypt | 81,700,000 | 73,500,000 |  |
| 17 | Turkey | 71,900,000 | 69,100,000 | |
| 18 | Congo | 66,500,000 | 65,100,000 |  |
| 19 | Iran | 65,900,000 | 61,600,000 |  |
| 20 | Thailand | 65,500,000 | 58,400,000 |  |
As one sees, Zipf’s law is not particularly precise at the extreme edge of the statistics (when
This data set has too few scales in base 
| |
Countries with  binary digit populations |
Number | Pareto prediction |
| 31 | China, India | 2 | 1 |
| 30 | ” | 2 | 2 |
| 29 | “, United States of America | 3 | 5 |
| 28 | “, Indonesia, Brazil, Pakistan, Bangladesh, Nigeria, Russia | 9 | 8 |
| 27 | “, Japan, Mexico, Philippines, Vietnam, Ethiopia, Germany, Egypt, Turkey | 17 | 15 |
| 26 | “, (Dem. Rep. of the) Congo, Iran, Thailand, France, United Kingdom, Italy, South Africa, (South) Korea, Burma (Myanmar), Ukraine, Colombia, Spain, Argentina, Sudan, Tanzania, Poland, Kenya, Morocco, Algeria | 36 | 27 |
| 25 | “, Canada, Afghanistan, Uganda, Nepal, Peru, Iraq, Saudi Arabia, Uzbekistan, Venezuela, Malaysia, (North) Korea, Ghana, Yemen, Taiwan, Romania, Mozambique, Sri Lanka, Australia, Cote d’Ivoire, Madagascar, Syria, Cameroon | 58 | 49 |
| 24 | “, Netherlands, Chile, Kazakhstan, Burkina Faso, Cambodia, Malawi, Ecuador, Niger, Guatemala, Senegal, Angola, Mali, Zambia, Cuba, Zimbabwe, Greece, Portugal, Belgium, Tunisia, Czech Republic, Rwanda, Serbia, Chad, Hungary, Guinea, Belarus, Somalia, Dominican Republic, Bolivia, Sweden, Haiti, Burundi, Benin | 91 | 88 |
| 23 | “, Austria, Azerbaijan, Honduras, Switzerland, Bulgaria, Tajikistan, Israel, El Salvador, (Hong Kong SAR) China, Paraguay, Laos, Sierra Leone, Jordan, Libya, Papua New Guinea, Togo, Nicaragua, Eritrea, Denmark, Slovakia, Kyrgyzstan, Finland, Turkmenistan, Norway, Georgia, United Arab Emirates, Singapore, Bosnia and Herzegovina, Croatia, Central African Republic, Moldova, Costa Rica | 123 | 159 |
Thus, with each new scale, the number of countries introduced increases by a factor of a little less than 
These laws are not merely interesting statistical curiosities; for instance, Benford’s law is often used to help detect fraudulent statistics (such as those arising from accounting fraud), as many such statistics are invented by choosing digits at random, and will therefore deviate significantly from Benford’s law. (This is nicely discussed in Robert Matthews’ New Scientist article “The power of one“; this article can also be found on the web at a number of other places.) In a somewhat analogous spirit, Zipf’s law and the Pareto distribution can be used to mathematically test various models of real-world systems (e.g. formation of astronomical objects, accumulation of wealth, population growth of countries, etc.), without necessarily having to fit all the parameters of that model with the actual data.
Being empirically observed phenomena rather than abstract mathematical facts, Benford’s law, Zipf’s law, and the Pareto distribution cannot be “proved” the same way a mathematical theorem can be proved. However, one can still support these laws mathematically in a number of ways, for instance showing how these laws are compatible with each other, and with other plausible hypotheses on the source of the data. In this post I would like to describe a number of ways (both technical and non-technical) in which one can do this; these arguments do not fully explain these laws (in particular, the empirical fact that the exponent
What's new
New polymath blog, and comment ratings
28 July, 2009 in admin, polymath | Tags: comment ratings | by Terence Tao | 7 comments
In view of the sustained interest in new polymath projects, Tim Gowers, Gil Kalai, Michael Nielsen, and I have set up a new blog to propose, plan, and run these projects. This blog is not intended to hold a “monopoly” on the polymath enterprise, but to merely be a convenient central location for discussing and running such projects should one choose.
We have started the ball rolling on this blog with some proposed rules for running a polymath, a mock-up of what a research thread and a discussion thread for a project would look like, two new proposals for the next polymath project (deterministic location of primes, and a problem of Michael Boshernitzan), and a thread on how one should select the next project (which we intend to do in a few months, with a tentative plan to actually start the next project at around October or so). Please come give the blog a visit, and contribute your thoughts and suggestions, though it should be noted that we are not planning to start a new polymath project right away, but merely to plan for the next one for now.
[Update, July 28: Actually, this may change. There has already been enough progress on the “deterministic location of primes” project that a discussion thread and wiki page has been created, and this polymath project may in fact formally launch much sooner than anticipated, perhaps in a matter of weeks. However, much work still needs to be done in laying the groundwork of this project, in particular developing preparatory materials in the wiki and elsewhere to allow participants to get up to speed.]
On a somewhat related note, now that we have a dedicated blog for these sorts of polymath projects, I am thinking of revisiting the ratings system for comments that I recently turned on here. I guess this would be a good question to poll the readers on:
Note that the ratings system is somewhat customisable: see this wordpress page for details.