« PDC Bound | Main | Why Is It Still So Amazing When a Computer Dials a Phone? »

September 08, 2005

An Open Letter to Jeff Raikes

TO:
Jeff Raikes
Group Vice President, Information Worker Business
Microsoft

FROM:
Adam Barr
Program Manager
Microsoft

Jeff,

No doubt you're aware of the recent fuss over Massachusetts' decision to require open formats for its official documents. Microsoft's predictable response was to plead confusion, hurt, and sorrow for the innocent users forced to abide by such a policy. I have another idea. Instead of responding like a sad puppy, Microsoft should embrace what Massachusetts is proposing.

I'm not suggesting that Microsoft support OpenDocument. Far from it. As you know, standards move slowly and can be perpetually one generation behind the state of the art. Microsoft is correct that its XML format is more advanced than OpenDocument, and in this case there is no reason for Microsoft to shackle itself to a standards body.

No, I'm saying that Microsoft should go back to the fundamental reasoning behind the Massachusetts decision, and embrace that. Massachusetts is not adopting OpenDocument for its own sake; it is adopting it because it meets a set of criteria the state has established--criteria which Microsoft could also meet if it chose to.

If you look at the "government requires openness" movement, you can classify it into three types of openness:

  • Requirements for open source software
  • Requirements for standards-based formats
  • Requirements for open formats

The first two are cost-saving measures: Either directly by requiring open source software, or indirectly by requiring standards-based format, which effectively lower the unique value proposition of any given piece of software which uses that format, thus presumably lowering the price.

But the third is not about cheaper software. It's about making data available in the case that a supplier goes out of business, or the government wants to process the data in a way that the software provider did not expect, or, most importantly, the situation decades in the future where data has been preserved but a computer that can run today's software has not. As noted on a Massachusetts web site, "if we have a record in a format of 2005, and it must be converted in 2038 into something not yet invented, we need to be able to do that without losing the integrity in the underlying information."

It's apparent that Massachusetts is opting for the third type of openness, because it is allowing PDF as a format. PDF is unquestionably 1) not open source 2) under the complete control of Adobe alone 3) covered by many patents. BUT, the patents are licensed to anyone on a royalty-free, non-exclusive basis for the term of each patent. This is how Massachusetts defines open formats: "Open Formats are specifications for data file formats based on an underlying open standard, developed by an open community, and affirmed by a standards body; or de facto format standards controlled by other entities that are fully documented and available for public use under perpetual, royalty-free, and nondiscriminatory term." (italics mine)

The key point about this third type of openness is that Microsoft can adopt it with no change to its current plans. It can continue to charge money for Office, and it can continue to change the Office file format at will. All it has to do is document it publicly, and license it freely. In particular, Microsoft should take its current Office formats and license them freely, from this day forward. That is what I am proposing to you.

License it freely...I know the knee-jerk reaction is to say "never". But what value is Microsoft deriving from Office's format right now? The format has been reverse-engineered by everyone anyway, even without Microsoft's permission. If you license it freely, you can change from it being a de facto standard to being a real standard, and keep OpenDOcument from encroaching on your turf. Most importantly, Microsoft can stand up and say "Yes, we support openness in governments" and direct the conversation towards open formats and away from open source and standards bodies. Instead of fighting the openness movement, the company can become a thought leader in it.

Remember this doesn't mean Microsoft has to submit its format to a standards body. It can still innovate as it always had, and keep ahead of the competition, just as the new XML formats are ahead of OpenDocument. Microsoft doesn't have to document its formats one second before it ships a new version of Office, which is about six months after people have reverse-engineered the format from the beta anyway.

Look, if you're really concerned about PSS calls from third party software producing sketchy .DOC files, then simply license the format for reading only, not for writing. Most of the benefits of open formats come from everyone being able to read your format, and most of the concerns come from others being able to write your format. Yes it's not what Massachusetts is talking about right now, but look at Massachusetts' stated reasons for wanting open formats: "Simply put, the question is whether, when we look back a hundred years from now, we will be able to read the records of what we did today...the Commonwealth will only certify an Open Format designation when minimal legal restrictions exist on the reading and dissemination of public records." Nothing about being able to write it, and why should there be, so I don't see how they could legitimately complain about patent restrictions on writing the format.

But that's a minor point. The main thing is that Microsoft needs to show some leadership, not reactive PR spin. It needs to license its current Office formats, royalty-free, perpetually, non-exclusively, and it needs to do it NOW.

Thank you.

Adam

Posted by AdamBa at September 8, 2005 11:54 PM

Trackback Pings

TrackBack URL for this entry:
http://proudlyserving.com/cgi-bin/mt-tb.cgi/311

Comments

Two thoughts on that:
1. When I read about the MA decision I thought of you (how odd considering I don't even know you).
2. If I didn't know that you report to Jim instead of Jeff I would say something about cajones. But huzzah anyway, Adam!

I'd give you the cajones prize if you took on the as-yet-undoc'd changes in the new boot loader, though. Same story; different book.

Posted by: Drew at September 9, 2005 03:43 AM

Thanks.

Posted by: Chris at September 9, 2005 07:01 AM

Interesting article, thanks. I have to take issue with your assertion: "I'm not suggesting that Microsoft support OpenDocument. Far from it. As you know, standards move slowly and can be perpetually one generation behind the state of the art. Microsoft is correct that its XML format is more advanced than OpenDocument, and in this case there is no reason for Microsoft to shackle itself to a standards body." This is utter baloney. Office XML may be more advanced than OpenDocument in some ways, but the fact is that OpenDocument pioneered many of the changes being proposed for Office XML (zip file based, etc.) and shipped them YEARS before Office 12 will. Fact is, OASIS started working on standardizing OpenDocument in 2002, based on the code that SHIPPED in OpenOffice well before that. Seems to me that Microsoft is the one who's a generation (or more) behind, and if the new Office 12 file formats weren't better than the OpenDocument formats they were "inspired" by, then that would just mean that Microsoft had utterly failed to come up with anything new when responding to a 5 year old file format.

Posted by: Andrew Shebanow at September 9, 2005 09:41 AM

Andrew, you're saying that OpenDocument pioneered the concept of an XML file format. That's not what I'm talking about. I mean the specifics of how rich the format can be. This is what Microsoft is complaining about -- can you embed such-and-such random object, or support such-and-such formatting notion, in the schema.

- adam

Posted by: Adam Barr at September 9, 2005 02:32 PM

Actually, according to Gary Edwards, who is on the OpenDoccument technical committee, they worked very hard to make sure the standard could handle everything in Microsoft's file formats, and is highly extensible for the future.

Posted by: Eduardo at September 9, 2005 07:03 PM

Adam, regarding licensing of Office formats - have you read through this letter? http://www.microsoft.com/office/xml/janletter.mspx ?

Specifically, it states that:

• The technical documentation is available on the Internet for anyone to copy and read
• The schemas are based on the W3C XML standard
• The license is royalty-free
• The license is perpetual
• The license is very brief and available to everyone

Posted by: Oleg at September 9, 2005 08:57 PM

Oleg, it looks like Microsoft is resolving any issues towards having everyone consider the Office XML open. But that's not what I'm talking about. There are millions of .DOC files out there. Yes, you can save them in XML in Word 2003, and there will be programs you can run to convert .DOC to .XML...but in fact few people save as XML and few people will run the converters, and the .DOC files will sit around forever.

I especially don't see why Microsoft cares about keeping .DOC proprietary when XML is going to be the default in Office 12 anyway.

- adam

Posted by: Adam Barr at September 9, 2005 09:43 PM

Adam,

Sounds like a very reasonable suggestion. Out of interest though, couldn't this have been sent to Jeff internally vs a public forum? Isn't Jeff just as focused on doing the right thing for the company and its customers? If so, shouldn't he be receptive to creative suggestions such as this one? I'm a MSFT shareholder and am trying to understand why employees seem to increasingly be choosing the public route vs going through internal channels. If it's because senior executives like Jeff aren't receptive, then I'm very concerned and Ballmer et al need to deal with that asap.

Posted by: Bob at September 9, 2005 10:39 PM

Bob:

>I'm a MSFT shareholder and am trying to understand why employees seem to increasingly be choosing the public route vs going through internal channels.

It's because of how Microsoft is really run. It's both from the top and from the bottom. It's a consensus-driven culture here. So, if you want to enact change you can't do it from just the top. You've gotta do it from the bottom too.

So, when we post things publicly we're trying to change both the top and the bottom at the same time. It's amazing how much more effective it is to do this work in public, by the way. Maybe that's a bad thing. I don't think so, though.

This is a FUNDAMENTAL SHIFT in how corporations work. One that we're just starting to figure out ourselves. But, one that has much better scale and makes employees much more bought into the process. And, because the work is done in public view it's usually a lot stronger work too.

Posted by: Robert Scoble at September 10, 2005 02:03 AM

Typical Scoble. Likes to pretend he can be critical of management when it's a soft intangible issue like discrimination.

When it comes to something concrete like opening up file formats, not a peep on his blog.

What a doofus.

Posted by: James at September 10, 2005 07:15 AM

"So, when we post things publicly we're trying to change both the top and the bottom at the same time. It's amazing how much more effective it is to do this work in public, by the way. Maybe that's a bad thing. I don't think so, though."

Thx Robert although I'm interested in hearing Adam's perspective esp in this case which seems pretty straightforward (i.e. visible problem, possible creative solution that needs to go up the chain and be reviewed by the VP in charge). Personally, I understand and respect the need for public bloggers like yourselves to maintain some objectivity and not just be a conduit for passing out the Kool Aid. But I'm not at all convinced that this increasingly public pitting of employees vs mgt is good for the company/customers or shareholders. In particular, I find it concerning that many such posts have an implicit tone that mgt either doesn't get, doesn't want to, or (worst of all) isn't being honest. Resonable people can disagree, but if/when the very motivations/voracity/customer focus of mgt is suspect, then the answer is change mgt not escalate public visibility. Again, I'm not suggesting that Adam's post does any/all of these or is one of the more aggregious - a few of Dare's recent ones come to mind for that. I just think that at some point there's a line where public dissension is counter-productive internally and only fuels popular external perspections of MSFT as confused, non customer focused, etc.

Posted by: Bob at September 10, 2005 11:45 AM

Bob, as you were entering your comment I was answering your original question in a separate post:

http://www.proudlyserving.com/archives/2005/09/emailing_execut.html

My personal opinion is, this kind of public debate is healthy. We are customer-focused because we are debating how to make things better for customers.

But as I said in my other post, I am also doing this in public to increase the chance of it happening.

- adam

Posted by: Adam Barr at September 10, 2005 12:13 PM

Responding to your response to my original comment: no, that is not what you said. You said standards bodies were slow and a generation behind. I dispute this: in this case, Microsoft is clearly trying to catch up with an existing standard, and the fact that the existing standard doesn't support every little feature Microsoft wants doesn't a priori turn the standards body into a follower instead of a leader.

Posted by: Andrew Shebanow at September 10, 2005 04:22 PM

Thx for the response Adam. Your detailed answer at least let's me understand your reasoning. It's also clear that your motivation is to help customers and the company and imo that's critical generally and in particular with public posts such as this one. Don't get me wrong, as a shareholder, I'm fully aware that MSFT has major problems and am all for seeing them raised and addressed. I just think that employees who similarly want to see the company get better need to be cautious that their posts aren't adding more fodder for the company's many external detractors (i.e. will it do more harm than good?). And of course, if they've already given up on the company and management generally, then they should just move on to somewhere where they can feel good about both vs blogging about it publically or hiding behind "well, it sucks but I like my immediate group".

Posted by: Bob at September 10, 2005 04:34 PM


Come on the real reason that he posted this rather than just mailing it to Jeff Raikes is he has fallen victim to the delusional blogger self-importance disease. This is where they become convinced that everything should be blogged about and that normal (and often private) communication channels are inappropopriate.

Posted by: Adam at September 10, 2005 05:46 PM

You know, there are good reasons why programmers should never somehow think they are automatically MBA's or Lawyers. Royalty-free? Why? Just give away the keys to the kingdom? What you get in return? Non-Exclusive? In things legal, nothing is EVER non-exclusive, always exceptions, time limits and extenuating circumstances. Perpetually? That sure ties your hands, as who knows what the future holds? This makes overall zero economic sense, and I suspect, as with most of the blog dandruff of late, the Exec's will just be amused, and move on. Make good formats, closed as such may be; market share is it's own standard. Case by case...

Fundamental Shift? Eh? So the Mailroom Clerk can tell the Doctor which medicines to prescribe? Do be serious. It's just a buncha programmers with a newfound CMS megaphones playing God and barking at the Moon. Pat them on the head, say nice doggie, and give them a treat. Don't take them too seriously, they aren't representive of the whole.

Posted by: Christopher Coulter at September 11, 2005 02:10 AM

Another useful thing that MS could do would be to document how to implement text converters. That would make it possible to simply plug into Office's various File Open and Save As dialogs, and handle 'foreign' documents directly in Word.

Posted by: Mike Dimmick at September 11, 2005 03:37 AM

MS Office could easily add the ability to read and write OpenDocument formats. This would not require "Microsoft to shackle itself to a standards body", but would only require MS Office to add some options in the Open and SaveAs dialogs. The only reason I can think of that they won't do this, is because they're not satisfied with providing successful software, but are driven to rule the world and stamp out all competition, by any means necessary, even if that means annoying customers.

Posted by: jonathan at September 11, 2005 07:13 AM

Christopher: If it's such a terrible idea, how come Microsoft is doing precisely this for its new XML formats? Why does Adobe do it for PDF? This notion that file formats are "the keys to the kingdom" is outdated.

Jonathan: OK so you add some options to the Open and Save dialog...what about the code to actually implement this? Who writes and tests that? The UI design of this is not the gating factor here.

- adam

Posted by: Adam Barr at September 11, 2005 08:02 AM

I am not sure there is such a thing as delusional blogger self-importance disease. When I do test software, if I have a bug to report, I report it. I don't loose my time thinking that a tester smarter than me already found it and reported it. Nor do I think a developer smarter than me coded the feature and I must be crazy to think it is broken.

Classical Office formats are about to become obsolete, and there is no real business reason to keep them in obscurity (I can imagine possible security reasons, but I am not sure they exist). There is a real business case in opening them, though.

Actually, I have similar feelings about Microsoft not including MFC and ATL in Visual C++ Express, but then, I don’t work for the company...

Posted by: Diego Vega at September 11, 2005 04:29 PM

Can you imagine buying a Verison phone and not be able to talk to someone with a land-line or Cellular-One phone?

I think there is a real underestimation of how much more savy consumers are getting wrt computers.

MadMoney Kramer says, "SELL"

Posted by: michael reavey at September 12, 2005 06:00 PM

If Microsoft's Office suite is as good as advertised, you have no fear in adding an option of SAVE AS->OpenDocument. I gather being "tied" to and open standard is just not in Microsoft's business model? Does Microsoft consider the bad image it gets from being so closed and restricted? I mean, its product is suppose to serve the user, Microsoft's customer, by giving the user a choice.


Posted by: Sergio at September 12, 2005 10:42 PM

Responding to Eduardo here:

Posted by: Eduardo at September 9, 2005 07:03 PM

Adam, regarding licensing of Office formats - have you read through this letter? http://www.microsoft.com/office/xml/janletter.mspx ?

Specifically, it states that:

• The technical documentation is available on the Internet for anyone to copy and read
• The schemas are based on the W3C XML standard
• The license is royalty-free
• The license is perpetual
• The license is very brief and available to everyone

No dice.

It's very brief, but it disallows the GPL and programs that SAVE the documents as something else (not just OPEN and READ like Jean says it can do), so really all you can do is open and read. You also can't make any modifications to how it saves the documents (You need to implement it precisely, no embrace and extend).

I assume "print" will make it in there as well shortly.

Posted by: at September 13, 2005 06:26 AM

I'm glad I re-read this, because I was going to comment about how there is a Word Viewer, which means I was completely missing the point. But I think you are right on when talking about formats and being able to have them available in the future in case there wasn't an application to use.

The idea behind having an open format is good, but there is difficulty in pursuing a solution to this. Everything has its pro's and con's, I guess it just depends on what works best for the situation. Most of the time it seems like people are too eager to go with an idea without even having a test solution.

I've seen that happen all too often and then having to return back to how things were done before, essentially returning to the same problem. Trial and error works good at certain times, but playing around with that ends up costing in the end, both financially and time spent. I wouldn't be surprised if Massachusetts went back to how things were being done. That would be a shame to see a failure like that depending on the time and money they put into it. Only time will tell though.

Posted by: Paul at September 13, 2005 10:59 AM

Hi, I don't understand when you say "and most of the concerns come from others being able to write your format"

What concerns?

Posted by: Tony at September 14, 2005 08:30 AM