Inconsistency between WMAP data and released map

Joined
Feb 10, 2009
Messages
9,361
It seems the Chinese aren't real keen on the WMAP data:

http://arxiv.org/abs/1001.4643

A remarkable inconsistency between the calibrated differential time-ordered data (TOD) of the Wilkinson Microwave Anisotropy Probe (WMAP) mission, which is the input for map-making, and the cosmic microwave background (CMB) temperature maps published by the WMAP team is revealed, indicating that there must exist a serious problem in the map making routine of the WMAP team. This inconsistency is easy to be confirmed without the use of WMAP map-making software. In view of the importance of this issue for cosmology study, the authors invite readers to check it by themselves.

The same pair also release a new paper recently:

http://arxiv.org/abs/1003.1073

The cosmic microwave background (CMB) temperature maps from the Wilkinson Microwave Anisotropy Probe (WMAP) are of great importance for cosmology. After finding out significant systematics in official WMAP maps, we had developed our own map-making software independently of the WMAP team. The new maps produced from the WMAP raw data and our software are notably different to the official ones, and the power spectrum as well as the best-fit cosmological parameters are significantly different too. By revealing the inconsistency between the WMAP raw data and their official map, we pointed out that there must exist an unexpected problem in the WMAP map-making routine. Here we state that the trouble comes from the inaccuracy of antenna pointing direction caused by improper offset of the quaternion interpolation in the WMAP routine. The CMB quadrupole in the WMAP release can be generated from a differential dipole field which is completely determined by the spacecraft velocity and the antenna directions without using any CMB signal. After correcting the WMAP team's error, the CMB quadrupole component disappears. Therefore, the released WMAP CMB quadrupole is almost completely artificial and the real quadrupole of the CMB anisotropy should be near zero. Our finding is important for understanding the early universe.

Anyone care to comment on these papers?
 
Well there is a counter from the WMAP team:
http://jp.arxiv.org/abs/1001.4758
We examine several potential or previously claimed anomalies in the sky maps and power spectra, including cold spots, low quadrupole power, quadropole-octupole alignment, hemispherical or dipole power asymmetry, and quadrupole power asymmetry. We conclude that there is no compelling evidence for deviations from the LCDM model, which is generally an acceptable statistical fit to WMAP and other cosmological data.
 
Inconsistency in WMAP Data?

The two authors of these papers came to Caltech to talk about their work, but unfortunately I didn't know they were coming until they were already gone. In April they will be at UC Berkeley and they may return to Caltech late in April. So I may have more to say then.

I received a copy of the 2nd paper (The origin of the WMAP quadrupole) the day before it was placed on arXiv and yesterday presented both papers in a journal club meeting of the astrophysics group at JPL, including several members of the CMB community with experience on WMAP. We came quickly to the conclusion that the authors must be wrong, on deciding that their principle claim is too severe and could not have been overlooked by the WMAP team. See this 2nd paper, wherein we find the reason they claim the WMAP data are flawed ...


From the abstract:
"Here we state that the trouble comes from the inaccuracy of antenna pointing direction caused by improper offset of the quaternion interpolation in the WMAP routine."

From page 2:
"The difference between the resulting antenna directions from different interpolation offset settings is small, only ~7', just about a half-pixel in the WMAP resolution (with HEALPix resolution parameter Nside = 512)."
The authors might think that 7 arcminutes or 1/2 pixel is "small", but nobody in the room with me was prepared to tolerate such an idea. The spacecraft pointing is rigorously tested many times in the map making process, against point source catalogs with milliarcsecond accuracy and precision. In the map making process, rather than subtract foreground point sources (because it requires a PSF fit), the source pixels are blanked out. Bright sources (and there are plenty of them) require more than one pixel to be blanked and an offset that large would mean the wrong pixels get blanked and point source artifacts will be created in the maps which would be obvious to anyone. These two considerations, the absence of point source artifacts in the maps, and the accuracy & precision of the pointing tests make an error so large as 7' too much to believe.

We believe the authors have probably made the mistake of misinterpreting the time ordered data (TOD) time flags. The antennae actually scan the sky in a complex pattern of overlapping ellipses which must then be interpreted as a map of the sky (see WMAP Scan Strategy). The TOD are binned into 2 or 3 samples per beamwidth and each sample receives a time stamp from the digital electronics unit (I think; see WMAP Receivers). The point is that the data are actually integrated over a window of time, but assigned an arbitrary time stamp that usually coincides with analog to digital conversion. In the map making routines the telescope pointing has to coincide with the time stamp on the TOD. This procedure is typical of any device that does not take an instantaneous measure, not just WMAP.

The authors here have concluded that the WMAP pointing error amounts to 1/2 sample, which is a suspicious number. At this point we must refer once again to the paper Origin of the WMAP quadrupole:

From page 2:
"In order to reduce the data size roughly only one quaternion is recorded for each WMAP science frame, whereas each science frame contains 12-30 observations. Therefore, the quaternion data must be interpolated to determine the spacecraft attitude for each observation. To do the interpolating, the offset of each observation to the start of the frame must be used. For example, for the Q-band, there are 15 observations in one frame. Ordinarily, in such interpolation the recorded quaternion for the start of the frame is used as the starting value of the interpolation, and then 0.000, 0.066, ... , 0.933 are used as offsets for observation 1,2, ..., 15, respectively. But, oddly, the WMAP team take 0.033, 0.099, ..., 0.967 as the offsets."
We don't know what "ordinarily" is supposed to refer to in this context, but one might naively expect the time stamp to fall at the mid-point of the integration window instead of the endpoint. If by "ordinarily" the authors expect this, then they will be off by 1/2 frame in their timing, which is exactly what they claim to be the case, that WMAP is off by 1/2 frame in pointing. So it is likely that the WMAP offsets are in fact correct because they are properly using end-of-frame offsets instead of mid-frame offsets.

It is easy enough, in principle, to test this simply by testing the positions of cataloged point sources in the WMAP data. If they are not off by 7' then the authors here are wrong. It should be noted here that he authors are high energy physicists and experts in statistics & probability, but have no experience with spacecraft data or architecture. So this kind of mistake would not be out of the question for them. As far as I know, only one of their earlier papers has been submitted for publication (in Monthly Notices of the Royal Astronomical Society) but is still in the review process. Because of the long review process, the authors decided to place the rest of their papers on arXiv for community review.

That said, it still leaves open the questions raised in their first paper (Inconsistency between WMAP Data and Released Map). While it was not difficult to disbelieve the reason cited in the 2nd paper for the claimed mismatch between TOD and map, it may still be the case that there is a mismatch for some other reason. It was not clear to us (though we did not look very hard) that the process of reconstructing TOD from the map will work they way they think it will work, because of the geometric complexity of the TOD compared to the map. We should also take note of another comment from the authors in the first paper ... "It will be very helpful if the WMAP team can thoroughly re-check their map-making process to find out where and how the error occurs. But until now they have insisted that their result has no problem and have prevented to discuss it with us." So in fact the authors are not directly comparing their results with WMAP team results, but rather with results arrived at by Peter Freeman at Carnegie Mellon University (whom the authors credit & acknowledge in their 2nd paper). We felt that an inconsistency as large as claimed seems unlikely but arrived at no firm conclusion one way or another on that score.

Let us also not read more into the results then warranted. Suppose for the sake of argument that the authors are correct, and there does exist an inconsistency in the WMAP maps. Does this mean an end to standard cosmology? Not quite. First, keep in mind that COBE and WMAP arrive at mutually consistent results, using very different spacecraft, receivers, and map making routines. And we will soon be hearing from PLANCK, another entirely independent system, which has already scanned the entire sky, so we await developments there. Meanwhile, Liu & Li, at the conclusion of their 2nd paper tell us that ... "If the epoch when the angular scale of 90 degrees exit the horizon is as early as before the reheating period when the primordial density perturbations had not occurred, we could detect no CMB quadrupole." Now this hinges on the validity of the reason given in their 2nd paper, which seems not likely. Nevertheless, in general, an inconsistency of the type suggested here, if valid, may lead to changes in cosmological parameters, and alter our perception of details in inflationary cosmology, but does not indicate an fatal flaw in standard concordance cosmology.

Finally, let me add the comment that a quaternion is a 4x4 matrix that can be used to locate points on a sphere (like the sky, for instance) and avoid the singularities that normal polar coordinates will generate (see Quaternion on Wikipedia or Quaternion from Mathworld). And HEALPix is a software package for pixelization of the surface of a sphere (which is not as easy to do as you might think).
 
Excellent discussion, TT.

Overall, I think we are left with what you stated:

Nevertheless, in general, an inconsistency of the type suggested here, if valid, may lead to changes in cosmological parameters, and alter our perception of details in inflationary cosmology, but does not indicate an fatal flaw in standard concordance cosmology.
 
MM:

It appears that those (e.g. GeeMack) who disparage your knowledge and debating integrity make a good case. Here you are starting a new thread after abandoning the discussion on another thread when you were cornered and exposed as having nothing more than hollow arguments to support your rinky-dink cosmology. I guess you'll do the same here if the discussion exposes you again. Pathetic!
 
MM:

It appears that those (e.g. GeeMack) who disparage your knowledge and debating integrity make a good case.

Excuse me? GM has NO debating integrity whatsoever. It's all personal attack and he ignores the direct evidence presented. Give me a break.

Here you are starting a new thread after abandoning the discussion on another thread when you were cornered and exposed as having nothing more than hollow arguments to support your rinky-dink cosmology.

Huh? Which thread are you even talking about? I haven't abandoned any threads other than from shear boredom. How many time can I watch you folks deny direct physical empirical evidence before throwing up my hands in complete disgust?

I guess you'll do the same here if the discussion exposes you again. Pathetic!

Frankly I think this response was A) unwarranted, and B) beneath you PS. I simply started a thread based on a couple of new papers. That's all. Considering the way you folks lean on the personal attack as you primary means of communication you have no right to bitch about my debate style IMO. It's simply busy at work and I have a lot going on. This is simply a new thread on a new topic based on new data.
 
Before it gets out of hand...posts should address the OP, be civil/polite, and not attack the arguer.
Replying to this modbox in thread will be off topic  Posted By: Locknar
 
Inconsistency in WMAP Data? II

Posted to the arXiv astro-ph server 26 April 2010 (version 1) and 27 April 2010 (version 2): On the suspected timing error in WMAP map-making by Boudewijn Roukema and submitted to Astronomy and Astrophysics.
Abstract: About 70-80% of the previously estimated WMAP CMB quadrupole signal would be an artefact of incorrect Doppler dipole subtraction if the hypothesis of a small timing interpolation error were correct. Observations of bright foreground objects constitute part of the time-ordered-data (TOD). Scans of an object in different directions should be shifted by the would-be timing error, causing a blurring effect. Three half-years of the calibrated, filtered WMAP TOD are compiled individually for the four W band differencing assemblies (DA's), with no masking of bright objects, giving 12 maps for each timing offset. Percentiles of the temperature-fluctuation distribution in each map at HEALPix resolution N_side=2048 are used to determine the dependence of all-sky image sharpness on the timing offset. In the W band, the 99.999% percentile, i.e. the temperature fluctuation in the approx 503-rd brightest pixel, is the least noisy percentile. Using this statistic, the hypothesis that a -25.6 ms offset relative to the timing adopted by the WMAP collaboration gives a focus at least as sharp as the uncorrected timing is rejected at 4.6\sigma significance. The Q and V band maps also reject the -25.6 ms offset hypothesis at high statistical significance. The requirement that the correct choice of timing offset must maximise image sharpness implies that the hypothesis of a timing error in the WMAP collaboration's compilation of the WMAP calibrated, filtered TOD is rejected at high statistical significance in each of the Q, V and W wavebands. However, the hypothesis that a timing error was applied during calibration of the raw TOD, inducing a dipole difference signal, is not excluded by this method.

Roukema satisfied the main point that had arisen in my earlier discussion, mainly that pointing errors, either at the spacecraft, or in the analysis, would alter bright point sources to an extent that would already have made itself obvious. The suggestion put forth by Li & Liu of a pointing error does not stand up to Roukema's analysis.

However, Roukema properly points out that one should still be interested in the fact that Li & Liu were able to almost completely cancel the CMB quadrupole (see the discussion section of his paper). A timing error in the calibration of the raw time ordered data (TOD) would have no effect on pointing or positional data, but appear as an offset in flux density estimates. So the effect reported by Li & Liu might still be caused by a timing error in the calibration, which Roukema suggests should be investigated.

My previous conclusion stands unaltered, as far as I can see:
Nevertheless, in general, an inconsistency of the type suggested here, if valid, may lead to changes in cosmological parameters, and alter our perception of details in inflationary cosmology, but does not indicate an fatal flaw in standard concordance cosmology.
 

Back
Top Bottom