Narrow fact-checking is less than useless

Last night, Donald Trump gave a speech that included a bunch of statements about crime that the New York Times fact-checked for us. This summarizes what they found:

Many of Mr. Trump’s facts appear to be true, though the Republican presidential nominee sometimes failed to offer the entire story, or provide all of the context that might help to explain his numbers.

Putting aside the ridiculously low bar of “many facts appear to be true”, they failed to mention or explain that in every case, despite his factoids being narrowly true, the conclusions he was drawing from them, and suggesting we draw from them, were absolutely, incontrovertibly false.

This kind of reporting drives me bonkers. Crime stats, like all stats, are noisy, and from one year to another, in a specific city, you can find an increase or decrease — whatever you are looking for. But the overall trends are clear, and Trump’s assessment was utter bullshit.

Another, somewhat less savory, media outlet did a much better job, because they took the 10 minutes of Googling necessary to assemble some charts and put Trump’s facts in context.

Would it have been partisan for the NYT to put Trump’s facts into context with respect to the conclusions he was drawing from them? It just seems like journalism.


What is the “Middle Class?”

On the radio today, All Things Considered did a little “Brief History of the Middle Class.” Apparently, according to Pew Research center, a family is in the middle class if its income is between about $47k/yr and $141k/yr. They also have breakdowns of wealth (if you are in net debt, you are not middle class) and consumption.


My own definition middle class has more to do with economic security than it does with wealth, income, or many types of consumption. To wit:

If you do not need to worry about food, housing, transportation, health care, education for your children, and safety, and can look forward to a retirement with those same basic needs satisfied, and you are not at risk of losing any of those things immediately on some negative shock, like an accident, negative diagnosis, or loss of job, then you have achieved middle class status. My definition doesn’t have anything to do with iDevices, high speed Internet, vacation or dining out.

It’s tricky, because I think a lot of people who do have nice things, like fancy cars, and big houses, don’t actually have solid economic security. I don’t know if they’re middle class or not.

What do you think the definition of middle class should be?

technological progress, freedom to v. freedom from

Technology progresses. Most of the time, progress is good, sometimes bad, but in all times it creates new circumstances, and those circumstances have winners and losers. Our society is not good at recognizing when circumstances have changed. We tend to take, for a long time at least, the world-as-it-is as the world-as-it-ought-to-be.

But I see no reason it must be so. I wish we were better at evaluating our reality, deciding if we like it or want something else, and then, coming to consensus on what, if anything, should be done at a policy level to control our circumstances.


For example, remote control airplanes have been around for quite some time. They were rather expensive toys, and not easy to fly. Similarly, aerial photography has existed almost since the dawn of flight. Because paying a pilot of fly over some location for you and photograph it is not cheap, it tends to be done where value of the resulting photograh is high enough to justify the expense.

For whatever reasons, we were pretty much OK with that status quo and the laws surrounding it. For example, yes, someone could photograph you through your window, and a passing plane could catch you sunning in your yard. People do not like those thigns, but it was hard enough to do and easy enough to stop, that basically, everyone but celebs and paparazzi seemed fine with the world as it was.

Enter inexpensive, simple aerial photograph with UAVs. Today, anybody with a few hundred bucks can get aerial imagery, and in a few years, that might be $10’s or even $1’s. Whole new possibilities for surveillance open up and people are suddenly uncomfortable about their vulnerability.

Does this mean we need laws to stop aerial surveillance “abuse?” Or maybe we need to adjust our expectations of privacy? I dunno. We need to evaluate the situation anew, since technology has changed circumstances. The fact that the existing laws were fine does not mean they are fine.

Totally rad UAVI can think of lots of contemporary examples of this sort of change: facial recognition along with ubiquitous video cameras make it possible to track everyone, everywhere they show their faces. License plate reader technology allows someone to track everywhere you go. You could do the same before, with detectives or private eyes, but now it can be done in bulk, cheaply. Cookies on websites allow someone to track most of what you look like on the Internet. In essence, people’s expectation of privacy was actually the complex combination of the state of technology and the law together, not either separate from the other.

None of these technologies are sinister in and of themselves, but dropped into a an environment that was in legal equilibrium without them, I think we should expect that equilibrium to shift.

Zoom!Of course, there are historical examples of such adjustments. Prior to the ubiquity of the automobile, people did not need carriage licenses, nor did they need to carry liability insurance for carriage accidents. How long after cars became popular did we realize they were dangerous enough and important enough that we should require that drivers get training? I think most (though not all) people today regard drivers’ licenses as a good idea. A few decades after that, we started requiring drivers to carry liability insurance and today most states have some requirement, though it is amazingly low in some places. (I know that agreement is hardly universal that liability requirements are a good idea, but we have them.)

One contemporary problem that is not typically considered in this light is gun violence. One might say that extremely capable weapons have been available for a long time, but that they have been expensive enough and just tricky enough to obtain, that we, as a society, were comfortable with the status quo. Collectors and sportspeople had them, and they used them safely, more or less. Enter cheap, easily available weapons, and all of a sudden the game has changed. In fact, today you can 3D print a gun at home, and maybe in a few years you’ll be able to 3D print a most of a not-too-shabby automatic weapon. The technology is not going to go away, but because of the technology change, the status quo is going to shift. Can or should we try to shift it back?


My point is that I think there are many  people who advocate for a kind of technological determinism, suggesting, “well, tech marches on.” But history tells us that we clearly do not have to accept such outcomes if we don’t want them.

Freedom-loving readers will notice a whole lot of “we’s” in this essay. I’m afraid they’re right. I’m suggesting that the group sometimes make decisions that restrict an individual’s freedoms. I know there is a cost to that. But I also see costs in letting individuals restrict the freedom (and well-being) of many other individuals.

As always, practicality and balance will be hard to achieve. We all seem fine with driver’s licensure, but pet grooming licenses seem perhaps too far. Required liability coverage for drivers is OK, but we probably would not tolerate such a requirement for many other potentially dangerous-to-others activities.

I hope we will have spirited, informed debates on issues like privacy and autonomy and that the outcome, if not new norms and laws, are new, explicit reiterations of existing norms that were previously implicit.

Clever, disturbing

Apple was recently granted a new patent for technology that will disable your phone’s camera at concerts where photography is forbidden.

The patent uses an infrared signal, which could be picked up by the imaging sensor itself. This is rather ingenious and cunning, because you could not disable the shut-down sensor without disabling the camera yourself, since they are one and the same.

IPhone_5S_main_cameraDepending one how pervasive such tech became, and how closely integrated the detection, decoding, and disabling is to the actual silicon image sensor, it could become nearly impossible to defeat this tech, or to obtain a phone that doesn’t include it.

I find blocking cameras at concert venues mildly annoying, but the potential for abuse of this technology seems large. Will folks on the street use it to block being photographed? Will it be deployed in government buildinds? Outside cop-cars? Will the secret for how to disable everyone else’s phone get out?

Over the last few years we’ve seen some exciting benefits from ubiquitous deployment of cameras. People are getting caught doing things that are illegal or at least shameful. I’d be bummed to see some technology from Silicon Valley reverse this progress.



Detrumpify2 — some cleanup

Even though my short brush with Internet fame appears to be over (Detrumpify has about 920 users today, up only 30 from yesterday), pride required that I update the extension because it was a bit too quick-n-dirty for my taste. Everything in it was hard-coded and that meant that every update I made to add new sites or insults would require users to approve an update. Hard-coding stuff in your programs is a big no-no, starting from CS 101 on.

So, I have a rewritten version available, and intrepid fans can help me out by testing it. You will not find it by searching on the Chrome Web Store, instead, get it directly from here. It is substantially more complicated under the hood than before, so expect bugs. (Github here, in “v2” folder.)

An important difference between this and the classic version is that there is an options page. It looks like this:

Screen Shot 2016-06-28 at 11.33.34 AM The main thing it lets you do is specify an URL from which a configuration file will periodically be downloaded. The config file contains the actual insults as well as some other parameters. I will host and maintain several configuration files ToolsOfOurTools, but anyone who wants to make one (for example, to mock a different presidential candidate) will be able to do so and just point to it.

If you want to make changes locally, you can also load a file, click on the edit button, make changes, and then click on the lock button. From then on the extension will use your custom changes.

The format of the config file is simple. Here’s an example with most of the names removed:


  • actions  is a container that will hold one or more named sets of search and replace instructions. This file just has one for replacing trump variations, but one can make files that will replace many different things according to different rules
  • find_regex  inside the trump action finds a few variations of Trump, Donald Trump, Donald J. Trump.
  • monikers  section lists the alternatives.
  • randomize_mode  can be always , hourly , daily , and tells how often the insult changes. In always , it will change with each appearance in the document.
  • refresh_age  is how long to wait (in milliseconds) before hitting the server for an update.
  • run_info  tells how long to wait before running the plugin and how many times to run. This is for sites that do not elaborate their content until after some javascript runs. (ie, every site these days, apparently). Here, it runs after 1000ms, then runs four more times, each time waiting 1.8x as long as the last time.
  •   bracket  can be set to a two-element array of text to be placed before and after any trump replacement.
  • schema  is required to ID the format of this file and should look just like that.
  • whitelist  is a list of sites that are enabled to run the extension. Et voila.

Let me know if you experience issues / bugs! The code that runs this is quite a bit more complex than the version you’re running now. In particular, I’m still struggling a bit with certain websites that turn on “content security policies” that get in the way of the config fetch. Sometimes it works, sometimes it doesn’t.



nbc-fires-donald-trump-after-he-calls-mexicans-rapists-and-drug-runnersApropos of nothing, I have written a very simple Chrome extension (and a Firefox add-on) that replaces references to the Short-Fingered Vulgarian with any of several other aliases. The initial “seed” for the list came from Jezebel, which published a list of 70 such names for the Cheeto-Faced Ferret’s 70th birthday.

I really should take the time to make this plugin user-configurable, so that you can add your own insults.  However, that seems a lot of work for something that basically works ok as it is. If you want to see the (very simple) code, check it out here on Github. I’ll take pull requests. [Edit 7/6: have now done this and the link above points to the new version. Original version still available here.]

I plan to add new insults as I come across them (feel free to provide), at least through November 2016. If you have suggestions, please note that I’m only using family-friendly insults.




PS — A few people have noted that the plugin doesn’t run on this or that website. That’s because it uses a whitelist of websites. I chose to do this to make the plugin as compatible and friendly as possible. It will run on the New York Times, but not on GMail, for example, nor will it interfere with your transactions at First National Bank of Trump. If you are running the current version, Detrumpify2, you can change that list yourself by adjusting the configuration file. If using the “classic” version, you’ll have to write me and ask to change it, and when I do, you’ll have to re-approve the plugin with the new permissions. Because of that, I’m going to try to avoid adding new sites to the “classic” extension too many more times.


Taking back Public Policy

Hold on folks, I’m about to get highly normative.

You see, I keep running into people who claim to do “public policy” for a living, or their business card says “Director of Public Policy.”

But when I talk to them, I find out they don’t know anything about public policy. Worse, they don’t care. What most of these people do for a living is “trying to win” some game.

So public policy becomes “communications,” when there is a need to convince people that something is good for them, or supporting politicians directly, when simple communications doesn’t quite cut the mustard.

At best, I would call this work advocacy. But “Director of the Stuff We Want” does not sound so good, so we get “Director of Public Policy.”

Okay, whatever, I’m not an idiot. I get how things work in the real world. Down in the scrum, there is no public good, there is no “what is best?” There are only people fighting for what they want, and we all pretend that sorta kinda over enough time, we end up with outcomes that are a reasonable balance of everyone’s interests, intensity of interests (particularly important if you like guns), and resources (particularly important if you have lots of money).

Except that process seems to be whiffing a bit these days, no?

What I wish for “public policy” would be for the field to somehow professionalize, to set norms of behavior, to set some notion of this-bullshit-is-too-much. Maybe, if so many people purporting to offer policy analysis weren’t so entirely full of crap all the time, we could one day reach the point where people would take policy analysis half seriously again.

So, in the interest of brevity, here are some signs your policy work may be pure hackery:

  • You talk in absolutes. If you’re in the business of telling someone that solar power or electric utilities or oil and gas companies or wind turbines or nuclear  are wonderful or evil, you probably are not doing public policy work. You’re just confusing people and wasting everyone’s time and attention.
  • your salary includes a bonus for successfully causing / stopping something
  • you will not admit publicly to any shortcoming of your preferred position
  • you do not even read work that comes to different conclusions than yours
  • if you arrive at conferences in a private jet

I also notice a lot of people who “do” public policy are also attorneys. That makes sense — knowing how the law works certainly helps. But lawyering and policy work should not be the same. Lawyers have a well-developed set of professional ethics centered around protecting their clients’ interests while not breaking any laws. This is flying way too low to the ground for good policy work. The policy world should aspire to a higher standard. Based on the low esteem most folks feel for the legal profession, it seems reasonable that if we ever hope for people to take policy work seriously, we’ll need to at least view “our clients” more broadly than “who pays our salary.”

So, what is public policy? Well, I think it’s the process by which the impacts of choices faced by government are predicted and the results of choices already made are evaluated. It takes honesty, humility, and a willingness to let data update your conclusions.

Back in Real Life, public policy professionals, of course, also need skills of persuasion and influence in order advocate on behalf of their conclusions (and their employers’ conclusions, natch). But for the love of god, if you skip the analytical step, you’re not doing public policy, you’re doing assholery.



Apple Open Letter… eh

[ Updated below, but I’m leaving the text here as I originally wrote it. ]


By now, just about everyone has seen the open letter from Apple about device encryption and privacy. A lot of people are impressed that such a company with so much to lose would stand up for their customers. Eh, maybe.

I have to somewhat conflicting thoughts on the whole matter:


If Apple had designed security on the iPhone properly, it would not even be possible for them to do what the government is asking. In essence, the government plan is for Apple to develop a new version of iOS that they can “upgrade” the phone to, which would bypass (or make it easier to bypass) the security on the device. Of course, it should not be possible to upgrade the OS of a phone without the consent of a verified users, so this is a bug they baked in from the beginning — for their benefit, of course, not the government’s.

Essentially, though they have not yet written the “app” that takes advantage of this backdoor, they have already created it in a sense. The letter is therefore deceptive as written.


The US government can get a warrant to search anything. Anything. Any. Thing. This is has it has been since the beginning of government. They can’t go out and do so without a warrant. They can’t (well, shouldn’t) be able to pursue wholesale data mining of every single person, but they can get a warrant to break any locked box and see what’s inside.

Why should data be different?

I think the most common argument around this subject is that the government cannot be trusted with such power. That is, yes, the government may have a reasonably right to access encrypted data in certain circumstances (like decrypting known terrorist’s phones!) but the tools that allow that also give them the power to access data under less clear-cut circumstances as well.

The argument then falls into a slippery slope domain — a domain in which I’m generally unimpressed. In fact, I would dismiss it entirely if the US government hadn’t already engaged in important widespread abuse of similar powers.

Nevertheless, I think the argument that the government should not have backdoors to people’s data is one of practical controls rather than fundamental rights to be free from search.


I have recommendations to address both thoughts:

  1. Apple, like all manufacturers, should implement security properly, so that neither they nor any other entity possess a secret backdoor.
  2. Phone’s should have a known backdoor, a one-time password algorithm seeded at the time of manufacture, and stored and managed by a third party, such as the EFF. Any attempts to access this password, whether granted or denied, would be logged and viewable as a public record.

I don’t have a plan for sealed and secret warrants.


[ Update 2/17 11:30 CA time ]

So, the Internet has gone further and explained a bit more about what Apple is talking about and what the government has asked for. It seems that basically, the government wants to be able to to brute-force the device, and wants Apple to make a few changes to make that possible:

  1. that the device won’t self-wipe after too many incorrect passwords
  2. that the device will not enforce extra time-delay between attempts
  3. that the the attempts can be conducted electronically, via the port, rather than manually by the touch screen

I guess this is somehow different than Apple being able to hack their own devices, but to me, it’s still basically the same situation. They can update the OS and remove security features. That the final attack is brute force rather than a backdoor is hardly relevant.

So I’m standing behind my assessment that the Apple security is borked by design.

Privatization, aluminum sky-tube edition

This Congress still has some must-pass legislation to complete.

That includes a reauthorization bill that contains a bunch of much-needed reforms for the agency. But they slipped in a doozey of a change: complete privatization of air traffic control. The plan is to create a separate government-chartered independent non-profit to run the whole show, with the intention, of course, that it will be run much more efficiently than the ZAN-ARTCC-ATOPgovernment ever could. I liked quote from an unnamed conservative groups from another Hill article:

“To us it is an axiomatic economic principle that user-funded, user-accountable entities are far more capable of delivering innovation and timely improvements in a cost-effective manner than government agencies.”

Axiomatic, eh? Well, I think I see your problem…

Anyway, it’s worth taking a step back to think about this proposal from a few different angles. First, let’s remember what the FAA does. Really, there are three main activities:

  1. Write regulations
  2. Allocate funds for aviation-related programs (AIP and similar) and
  3. Run ATC (Note: the FAA’s ATC arm is called “ATO,” but I’ll keep calling it ATC here)

Honestly, there has always been something of a conflict between the needs of air traffic control with safety as top priority and efficiency and cost as lower priorities, and the rest of the organization’s needs. It is a small miracle that the FAA’s ATC runs the safest airspace in the world. But miracle or not, it is a fact.

Furthermore, it is also true that ATC has been slow to modernize. This is for several reasons. First, yes, government bureaucracy, of course. But there are other reasons, such as having congress habitually cut and delay funding for new systems (NB: when you are on temporary reauthorization, you don’t buy new things; programs do not progress. You just pay salaries.) Another problem is that the old systems, as cranky and obsolete as they are, work, and it’s just not a simple matter to replace a working system, tuned over decades with new technology, particularly if you require no degradation in performance in the process.

So does this justify privatization? Will a private organization do better in this respect? Well, here are some ideas for thought, in no particular order:

  • a private organization will use fees to fund itself. This might be good, because they should be able to raise all the money they need, but then again, fees might grow without control. A private organization running ATC is essentially a monopoly. Government control is a monopoly, too — except that you can use the levers of democracy to manage it
  • a fee-run organization will be mostly responsive to whomever pays the fees. In this case, it would be the airlines, and among the airlines, the majors would have the most bargaining power. Is this the best outcome? How will small carriers fare when it comes time to assign landing slots or assign routes to flight plans? How will general aviation do under such a system? Will fees designed for B747‘s coming into KEWR snuff out the C172 traffic coming into KCDW?
  • Regulatory capture is a problem for any industry-regulating government entity. Does the appointment of an all-industry board of directors for a private organization that assumes most of those functions “solve” that problem making total capture a fait accompli?
  • Will this new organization be self supporting or will it still depend on government money? How will it perform when there is an economic or industry slump? If there is a bankruptcy, who will foot the bill to keep the lights on?
  • When the inevitable budgets shortfalls come, how will labor fare? Will they have to sacrifice their contracts in order to help save the company?
  • I don’t know, but I’m just guessing, that nobody at the top of the FAA’s ATC today makes a million dollars a year. Will it be so under an private organization? If so, where might that money come from?
  • Does an emphasis on efficiency server the flying public? To that matter, do the flying public’s interests diverge from those of the airlines, and if so, how are they represented in the new organization’s decision-making?

I honestly have not considered or study this matter enough to have a strong opinion, but so much of it causes the hairs on my neck to stick out.

I’ll give the authors of this new bill credit for one thing: they managed to get the ATC union (NATCA) on board, essentially by promising continuity of their contracts and protections. I’m not sure if that comes with guarantees in perpetuity. One thing I noticed immediately is that current employees would be able to pay into the federal retirement system. New employees…


[ Full disclosure: I am a general aviation pilot and do not pay user fees to use ATC, and like it that way. I do understand that this is a subsidy I enjoy. ]




Freedom from v. freedom to: aviation edition

The FAA is still in its rule-making process for drones (or as they call them, UAS — unmanned aircraft systems), but they have announced that all drone operators must register themselves and their aircraft online. There will be a $3 fee (waived for early-registrants until 1/20/2016) and the registration lasts three years.

A quad-copter, quad-coptering.
A quad-copter, quad-coptering.

Some drone enthusiasts and some libertarians are up in arms. “It’s just a new technology that they fear they can’t control!” “Our rights are being curtailed for no good reason!” “That database will be used against us, just wait and see!”

I have a few thoughts.

First, I have more than a smidgeon of sympathy for these views. We should always pause whenever the government decides it needs to intervene in some process. And to be frank, the barriers set by the FAA to traditional aviation are extremely high. So high that general aviation has never entered the mainstream of American culture, and given the shrinking pilot population, probably never will. The price to get in the air is so high in terms of training that few ever get there. As a consequence, the price of aircraft remains high, the technological improvement of aircraft remains slow, rinse, repeat.

In fact, I have often wondered what the world might be like if the FAA had been more lax about crashes and regulation. Perhaps we’d have skies filled with swarms of morning commuters, with frequent crashes which we accept as a fact of life. Or perhaps those large volumes of users would spur investment in automation and safety technologies that would mitigate the danger — at least after an initial period of carnage.

I think I would be upset if the rules were like those for general aviation. But in fact registration is pretty modest. I suspect that later, there will be some training and perhaps a knowledge test, which seems quite reasonable. As a user of the National Airspace System (both as a pilot and a passenger) I certainly appreciate not ramming into solid objects while airborne. Registration, of course, doesn’t magically separate aircraft, but it provides a means for accountability. Over time, I suspect rules will be developed to set expectations on behavior, so that all NAS users know what to expect in normal operations. Call it a necessary evil, or, to use a more traditional term, “governance.”

But there is one interesting angle here: the class of UAS being regulated (those weighing between 0.55 lb and 55 lb) have existed for a long time in the radio-controlled model community. What has changed to make drones “special,” requiring regulation now?

I think it is not the aircraft themselves, but the community of users. Traditional radio-controlled models were expensive to buy, took significant time to build, and were difficult to fly. The result was an enthusiast community, which by either natural demeanor or soft-enforced community norms, seemed able to keep their model airplanes out of airspace used by manned aircraft.

Drones came along and that changed quickly. The drones are cheap and easy to fly, and more and different people are flying them. And they’re alone, not in clubs. The result has been one serious airspace incursion after another.

A lot of people seem to think that because drones aren’t fundamentally different technology from traditional RC hobby activity, that no new rule is warranted. I don’t see the logic. That’s not smart. It’s not about the machines, it’s about the situation.

Anyway, I think the future for drone ops is actually quite bright. There is precedent for a vibrant hobby along with reasonable controls. Amateur radio is one example. Yes, taking a multiple-choice test is a barrier to many, but perhaps a barrier worth having. Also, the amateur radio community seems to have developed its own immune system against violators of the culture and rules, which works out nicely, since the FCC (like the FAA) has limited capacity for enforcement. And it’s probably not coincidental that the FCC has never tried to build up a large enforcement capability.

Which brings me to my final point, which is that if the drone community is smart they will create a culture of their own and they will embrace and even suggest rules that allow their hobby to fruitfully coexist with traditional NAS users. The Academy of Model Aeronautics, a club of RC modelers, could perhaps grow to encompass the coming army of amateur drone users.