{"id":5019,"date":"2024-12-18T20:38:00","date_gmt":"2024-12-18T12:38:00","guid":{"rendered":"https:\/\/smartairfilters.com\/?p=5019"},"modified":"2025-03-28T15:31:47","modified_gmt":"2025-03-28T07:31:47","slug":"how-accurate-air-quality-monitors","status":"publish","type":"post","link":"https:\/\/smartairfilters.com\/en\/blog\/how-accurate-air-quality-monitors\/","title":{"rendered":"Are Air Quality Monitors Accurate?"},"content":{"rendered":"<p>A few months ago, Smart Air tested several air quality monitors, Laser Egg, the Node, and the Dylos, against official PM2.5 readings. <a href=\"https:\/\/smartairfilters.com\/en\/blog\/how-accurate-are-common-particle-counters-comparison-test\/\">The results were way better than I expected<\/a>! All three machines correlated <em>r<\/em> = .90 or higher with the gold-standard numbers, which is very high.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img fetchpriority=\"high\" decoding=\"async\" width=\"665\" height=\"400\" src=\"\/wordpress\/wp-content\/uploads\/2017\/11\/2-Particle-Counters-EN.png\" alt=\"Air quality monitor test review AirVisual Dylos Kaiterra\" class=\"wp-image-5306\" srcset=\"https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/2-Particle-Counters-EN.png 665w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/2-Particle-Counters-EN-300x180.png 300w\" sizes=\"(max-width: 665px) 100vw, 665px\" \/><\/figure><\/div>\n\n\n<p><\/p>\n\n\n\n<p>But this test may have exaggerated its accuracy. See, the Laser Egg and the Node are probably calibrated to PM2.5 readings in Beijing, so their formulas work great here. But how well do they work in different environments?<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Why Your Air Quality Monitor Might Not Be Accurate in Shanghai<\/h2>\n\n\n\n<p>Lots of environmental differences could make particle counters less accurate outside of Beijing. Two examples:<\/p>\n\n\n\n<ol class=\"wp-block-list  list-paddingleft-2\">\n<li>Beijing tends to be pretty dry, and&nbsp;<a href=\"https:\/\/www.quora.com\/How-does-humidity-affect-air-quality-ratings-for-PM-2-5-and-PM-10\">we know humidity affects laser particle counts<\/a>.<\/li>\n\n\n\n<li>Some cities may also have more of certain size particles. For example, Beijing might have more particles from the steel factories in Hebei, whereas Shanghai might have more vehicle exhaust particles. If these particles tend to be different sizes, the formula converting particle counts to micrograms would be less accurate.<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">Testing the Laser Egg in Guangzhou<\/h2>\n\n\n\n<p>Smart Air DIYer Nikki in Guangzhou teamed up with me to test her Laser Egg against the US Consulate in Guangzhou.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" width=\"570\" height=\"563\" src=\"\/wordpress\/wp-content\/uploads\/2017\/11\/3-Guangzhou-Map-EN.png\" alt=\"PM2.5 Air Quality Test China\" class=\"wp-image-5307\" srcset=\"https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/3-Guangzhou-Map-EN.png 570w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/3-Guangzhou-Map-EN-300x296.png 300w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/3-Guangzhou-Map-EN-60x60.png 60w\" sizes=\"(max-width: 570px) 100vw, 570px\" \/><\/figure><\/div>\n\n\n<p><\/p>\n\n\n\n<p>Nikki took 147 readings outside her apartment, which is 2.77 kilometers away from the consulate. This distance can make the readings less accurate, although&nbsp;<a href=\"https:\/\/smartairfilters.com\/en\/blog\/are-particle-counters-and-government-machines-the-same\/\">my tests with the US Embassy in Beijing from 7 kilometers away<\/a>&nbsp;showed results nearly identical to tests done 200 meters away.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Results<\/h2>\n\n\n\n<p>The Laser Egg correlated highly with the US Consulate (<em>r\u00a0<\/em>= .88), but much lower\u00a0<a href=\"https:\/\/smartairfilters.com\/en\/blog\/how-accurate-are-common-particle-counters-comparison-test\/\">than in Beijing<\/a>\u00a0(<em>r\u00a0<\/em>= .98). The Egg consistently overestimated PM2.5:<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" width=\"1661\" height=\"1158\" src=\"\/wordpress\/wp-content\/uploads\/2017\/11\/4-Laser-Egg-in-Guangzhou-vs-US-Embassy-EN.png\" alt=\"Laser Egg review test PM2.5 humidity\" class=\"wp-image-5309\" srcset=\"https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/4-Laser-Egg-in-Guangzhou-vs-US-Embassy-EN.png 1661w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/4-Laser-Egg-in-Guangzhou-vs-US-Embassy-EN-300x209.png 300w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/4-Laser-Egg-in-Guangzhou-vs-US-Embassy-EN-768x535.png 768w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/4-Laser-Egg-in-Guangzhou-vs-US-Embassy-EN-1024x714.png 1024w\" sizes=\"(max-width: 1661px) 100vw, 1661px\" \/><\/figure><\/div>\n\n\n<p><\/p>\n\n\n\n<p>The Laser Egg was off by an average of 23.53 micrograms. That is higher than in Beijing, where it was off by just 6.5 micrograms. (Open-source <a href=\"\/wordpress\/wp-content\/uploads\/2017\/11\/laser-egg-in-Guangzhou-156-points.xlsx\">raw data<\/a>&nbsp;is free for all).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Is The Laser Egg Inaccurate Because of Humidity?<\/h2>\n\n\n\n<p>I tested whether humidity was the culprit by analyzing humidity readings. Humidity ranged from 36% to 89%, so there was wide variation in humidity.<\/p>\n\n\n\n<p>Adjusting for humidity increased the accuracy of the Laser Egg readings. The model went from explaining 76.8% of the variance in PM2.5 to 79.4%. The Egg clearly had less error when humidity was low (left) than when humidity was high (right):<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"752\" src=\"\/wordpress\/wp-content\/uploads\/2017\/11\/5-Average-Error-vs-Humidity-EN-1024x752.png\" alt=\"Kaiterra Laser Egg error humidity data\" class=\"wp-image-5311\" srcset=\"https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/5-Average-Error-vs-Humidity-EN-1024x752.png 1024w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/5-Average-Error-vs-Humidity-EN-300x220.png 300w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/5-Average-Error-vs-Humidity-EN-768x564.png 768w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/5-Average-Error-vs-Humidity-EN.png 1495w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure><\/div>\n\n\n<p><\/p>\n\n\n\n<p>The graphs below are a bit complicated, so let me break them down. First, if the Laser Egg were perfectly accurate, 1 microgram on the Laser Egg would equal 1 microgram from the US Consulate (blue line):<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"1216\" height=\"1130\" src=\"\/wordpress\/wp-content\/uploads\/2017\/11\/6-Laser-Egg-Correction-1-EN.png\" alt=\"Laser Egg accuracy test PM2.5 humidity\" class=\"wp-image-5313\" srcset=\"https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/6-Laser-Egg-Correction-1-EN.png 1216w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/6-Laser-Egg-Correction-1-EN-300x279.png 300w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/6-Laser-Egg-Correction-1-EN-768x714.png 768w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/6-Laser-Egg-Correction-1-EN-1024x952.png 1024w\" sizes=\"(max-width: 1216px) 100vw, 1216px\" \/><\/figure><\/div>\n\n\n<p><\/p>\n\n\n\n<p>But the Laser Egg isn&#8217;t 100% accurate. When humidity is low (&lt; 50%), the actual relationship is off by a bit. In that case, 1 Egg microgram = .72 actual micrograms (middle line). And when humidity is high (&gt; 50%), the actual relationship is even worse, 1 Egg microgram = .60 actual micrograms (right line).<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"1711\" height=\"1199\" src=\"\/wordpress\/wp-content\/uploads\/2017\/11\/7-Laser-Egg-Correction-2-EN.png\" alt=\"Laser Egg accuracy test PM2.5 humidity\" class=\"wp-image-5315\" srcset=\"https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/7-Laser-Egg-Correction-2-EN.png 1711w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/7-Laser-Egg-Correction-2-EN-300x210.png 300w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/7-Laser-Egg-Correction-2-EN-768x538.png 768w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/7-Laser-Egg-Correction-2-EN-1024x718.png 1024w\" sizes=\"(max-width: 1711px) 100vw, 1711px\" \/><\/figure><\/div>\n\n\n<p><\/p>\n\n\n<div class='bottom-line'><div class='bottom-line-top'>Bottom Line<\/div><div class='bottom-line-title'>Bottom Line: The Laser Egg&#039;s Accuracy<\/div><div class='bottom-line-content'>\n<ul class=\" list-paddingleft-2\">\n<li>The Laser Egg is less accurate in Guangzhou than in Beijing.<\/li>\n<li>Humidity can explain at least some of this error.<\/li>\n<li>If you\u2019re in a more humid climate, actual PM2.5 is probably <strong>lower<\/strong> than what your Laser Egg is reading. <\/div><div class='bottom-line-last'>Smart Air<\/div><\/div><br \/>\n\n\n\n<h2 class=\"wp-block-heading\">Is This Just a Laser Egg Problem?<\/h2>\n\n\n\n<p>I\u2019ve also done lots of testing with the Dylos particle counter and found that&nbsp;<a href=\"https:\/\/smartairfilters.com\/data\/en\/open-data-accurate-1-micron-dylos-new-test\/\">high humidity makes it less accurate too<\/a>. So have&nbsp;<a href=\"https:\/\/www.scribd.com\/document\/263202091\/Drexel-Air-Monitoring-Final-Report-Team-19-0\">researchers at Drexel University<\/a>.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"624\" height=\"720\" src=\"\/wordpress\/wp-content\/uploads\/2017\/11\/8.png\" alt=\"Dylos DC1100 Air Quality Monitor\" class=\"wp-image-5316\" srcset=\"https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/8.png 624w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/8-260x300.png 260w\" sizes=\"(max-width: 624px) 100vw, 624px\" \/><\/figure><\/div>\n\n\n<p><\/p>\n\n\n\n<p>So far, I\u2019ve never seen a particle counter that takes into account humidity. Thus, I don\u2019t think this is just an Egg problem, so I don\u2019t mean to single out the Egg for criticism! Overall, <a href=\"https:\/\/smartairfilters.com\/en\/blog\/how-accurate-are-common-particle-counters-comparison-test\/\">the data has convinced me<\/a> that it\u2019s a great machine for relatively cheap, and that\u2019s why I decided to\u00a0carry it on our site until it went out of production. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Update: The QP Air Quality Monitors<\/h2>\n\n\n\n<p>Since publishing this article, our team at Smart Air has tested a new set of air quality monitors: The <a href=\"https:\/\/smartairfilters.com\/en\/product\/qp-lite-air-quality-monitor-qingping\/\">QP Lite<\/a> and <a href=\"https:\/\/smartairfilters.com\/en\/product\/qp-pro-air-quality-monitor-qingping\/\">QP Pro<\/a>. After <a href=\"https:\/\/smartairfilters.com\/en\/blog\/how-accurate-are-qingping-qp-pm2-5-air-quality-monitors\/\">testing<\/a> out the monitors, we were impressed with their accuracy and functionality. We have replaced the Laser Egg on our <a href=\"https:\/\/smartairfilters.com\/en\/shop\/\">Clean Air Shop<\/a>, with the QP monitors.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/Qp-pro-2-monitors-1024x1024.jpg\" alt=\"\" class=\"wp-image-34890\" srcset=\"https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/Qp-pro-2-monitors-1024x1024.jpg 1024w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/Qp-pro-2-monitors-600x600.jpg 600w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/Qp-pro-2-monitors-300x300.jpg 300w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/Qp-pro-2-monitors-768x768.jpg 768w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/Qp-pro-2-monitors-1536x1536.jpg 1536w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/Qp-pro-2-monitors-100x100.jpg 100w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/Qp-pro-2-monitors-120x120.jpg 120w, https:\/\/smartairfilters.com\/wordpress\/wp-content\/uploads\/2017\/11\/Qp-pro-2-monitors.jpg 1600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure><\/div>\n\n\n<h2 class=\"wp-block-heading\"><\/h2>\n\n\n\n<h2 class=\"wp-block-heading\"><strong style=\"color: var(--contrast);font-family: -apple-system, system-ui, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif, 'Apple Color Emoji', 'Segoe UI Emoji', 'Segoe UI Symbol'\">Open Data and a Correction Formula<\/strong><\/h2>\n\n\n\n<p>As always, I\u2019m posting the original data and more info on the test for fellow nerds, plus:<\/p>\n\n\n\n<ul class=\"wp-block-list  list-paddingleft-2\">\n<li>A&nbsp;correction formula that users in high-humidity cities like Guangzhou can use<\/li>\n\n\n\n<li>Is it really humidity? One reason it might be another variable.<\/li>\n\n\n\n<li>One reason I might actually be&nbsp;<em>underestimating&nbsp;<\/em>the effect of humidity!<\/li>\n<\/ul>\n\n\n\n<p>Happy particle counting!<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">More Data<\/h3>\n\n\n\n<p><strong>Correction Formula<\/strong><\/p>\n\n\n\n<p>Egg users in humid climates can use this formula to correct their numbers:<\/p>\n\n\n\n<p>PM2.5 ug\/m<sup>3<\/sup>&nbsp;=(Laser Egg micrograms x .981) + (Humidity x .052) + (Laser Egg micrograms xHumidity x -.006)<\/p>\n\n\n\n<p>But remember this is a very provisional formula, based on one egg in one city.<\/p>\n\n\n\n<p><strong>Maybe It\u2019s Not Actually Humidity?<\/strong><\/p>\n\n\n\n<p>Liam also pointed out a potential problem with analyzing humidity: changes in humidity may be confounded with other changes. For example, in Beijing, northern winds bring drier air, but they also probably bring different types of particles, such as the well-known spring sand storms. So when humidity drops, particle type also changes.<\/p>\n\n\n\n<p>But the problem is, we can&#8217;t tell different types of particles apart, so we don\u2019t know. All we have is humidity. And because we\u2019re only measuring humidity, we\u2019ll incorrectly conclude, \u201clook at all this effect of humidity!\u201d What&#8217;s more, if humidity is confounded with other variables, that would mean a humidity formula built on one city wouldn\u2019t work as well in other cities.<\/p>\n\n\n\n<p>Then again, perhaps I\u2019m&nbsp;<em>underestimating&nbsp;<\/em>the effect of humidity. Surely there\u2019s some error in our measurement of humidity, and that error might lead us to underestimate the effect of humidity.<\/p>\n\n\n\n<p>Ultimately, I think most people would agree that there\u2019s at least some effect of humidity on particle counters. If humidity is confounded with other particles, that would probably mean&nbsp;<strong>some<\/strong>&nbsp;effect of humidity is actually due to other variables. It\u2019s highly unlikely that&nbsp;<strong>all<\/strong><em>&nbsp;<\/em>of the effect of here is due to third variables.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\u200bIs Humidity Confounded with High AQI?<\/h3>\n\n\n\n<p>One potential problem with the analysis I did is if higher humidity tends to be accompanied by worse AQIs. Why? Because absolute error tends to be higher when readings are really high. For example, if the air is at 20 micrograms, it\u2019s really hard to be off by more than 10 micrograms or so. But when the air is at 200 micrograms, it\u2019s easy to be off by 20, 30, 40 micrograms. When concentration is high (according to the US Consulate), Egg error tends to be higher&nbsp;<em>r&nbsp;<\/em>= .45.<\/p>\n\n\n\n<p>However, humidity was actually negatively correlated with PM2.5 (as measured by the Consulate)&nbsp;<em>r&nbsp;<\/em>= -.23. So if anything, my formula here might be&nbsp;<em>underestimating&nbsp;<\/em>how much we need to correct for humidity.<\/p>\n\n\n\n<p><\/p>","protected":false},"excerpt":{"rendered":"<p>A few months ago, Smart Air tested several air quality monitors, Laser Egg, the Node, and the Dylos, against official PM2.5 readings. The results were way better than I expected! All three machines correlated r = .90 or higher with the gold-standard numbers, which is very high. But this test &#8230; <\/p>\n<p class=\"read-more-container\"><a title=\"Are Air Quality Monitors Accurate?\" class=\"read-more button\" href=\"https:\/\/smartairfilters.com\/en\/blog\/how-accurate-air-quality-monitors\/#more-5019\" aria-label=\"Read more about Are Air Quality Monitors Accurate?\">Read more<\/a><\/p>\n","protected":false},"author":1035,"featured_media":34892,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"3777,5189,18686,5843,22029,16318","_relevanssi_noindex_reason":"","footnotes":""},"categories":[169,262],"tags":[75,55,218,184,285,220],"class_list":["post-5019","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-air-quality-monitors","category-reviews","tag-beijing","tag-guangzhou","tag-humidity","tag-laser-egg","tag-review","tag-test","resize-featured-image"],"acf":[],"_links":{"self":[{"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/posts\/5019","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/users\/1035"}],"replies":[{"embeddable":true,"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/comments?post=5019"}],"version-history":[{"count":25,"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/posts\/5019\/revisions"}],"predecessor-version":[{"id":34961,"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/posts\/5019\/revisions\/34961"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/media\/34892"}],"wp:attachment":[{"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/media?parent=5019"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/categories?post=5019"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/smartairfilters.com\/en\/wp-json\/wp\/v2\/tags?post=5019"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}