CollabNet Leader: Software Development in a Sorry State

By Peter Galli  |  Posted 2005-02-01 Print this article Print

Brian Behlendorf, the chief technical officer and co-founder of CollabNet, says boosting motivation and getting rid of slow feedback loops are crucial to reversing a dismal trend.

BURLINGAME, Calif.—The current state of the corporate software market could best be described as a train wreck, Brian Behlendorf, the chief technical officer and co-founder of CollabNet, said here Tuesday at the OSDL (Open Source Development Labs) Enterprise Linux Summit. Industry research shows that some 45 percent of all software development projects in 2003 were canceled, with another 30 percent completed late and/or with reduced features, he said. "This trend is not headed in a positive direction, and failure rates have risen over the past 10 years. Recently, we have seen huge projects at both the Department of Defense and the IRS fail," Behlendorf said.
"In fact, Paul Brubaker, the former deputy chief information officer at the Pentagon, once said, referring to software projects, that there are very few success stories."
Click here for a column on why software projects fail. What lies behind these failures are slow feedback loops from inception to use, high underlying technology turn, poorly documented prior systems and requirements, the growing difficulty in estimating work, and demotivated developers, he said. A project-oriented mindset also "kills the community," Behlendorf said, adding that the life cycle of a software project does not end on a ship date. Teams often throw away the development artifacts they created along the way, or place them in obscure locations. "As a result of all of these factors, true software reusability is just a myth. While some companies have built asset repositories, they tend to have tarballs of source code and searchable metadata at best," he said. Developers also have scant incentives to properly prepare their components for reuse by others or to reuse others work. Software components are not like bricks that are simply stacked on top of one another, he said. "Essentially, all software has bugs, all software needs adaptation to new platforms over time, new requirements cannot always be wrapped around or above existing code, and APIs are conversations between components and need to evolve over time," Behlendorf said. The biggest hurdle to software code reuse is trust, Behlendorf said, turning to examine some of the open-source best practices. These include transparency through the entire process and the fact that forking is allowed but is mitigated by teams working together. Many corporations still harbor the illusion that the software development model is like an assembly line and that code should simply be cranked out. "But open-source software got a free pass on predictability, as no one gets fired if Apache ships a few weeks late, which has allowed for an interesting experiment," he said. The software development process must be seen as an ongoing environment, where interdependence is implicit and allows coordination between projects, thereby stimulating creativity, Behlendorf said. Discussions and online decision-making—where so much knowledge is created—must be captured, as often the code does not speak for itself and the documents and specifications are incomplete or inadequate, he said. "This makes everyone think about their words in a way that anticipates future review by people they do not know, which is a good skill and discipline to have," Behlendorf said. While personality conflicts are inevitable, they can be resolved by management and coaching, or by removing someone from the project. "This is one of the bigger problems the open-source community has—time and effort are wasted by fruitless argument," he said. Measuring a projects success is always critical, and those companies that adopt a more open development approach internally should achieve a more graceful and continuous life beyond the products release, Behlendorf said. This should make it easier to bring in new developers, and there should be fewer conference calls and less of an oral culture, he said. Check out eWEEK.coms for the latest news, reviews and analysis in programming environments and developer tools.
Peter Galli has been a financial/technology reporter for 12 years at leading publications in South Africa, the UK and the US. He has been Investment Editor of South Africa's Business Day Newspaper, the sister publication of the Financial Times of London.

He was also Group Financial Communications Manager for First National Bank, the second largest banking group in South Africa before moving on to become Executive News Editor of Business Report, the largest daily financial newspaper in South Africa, owned by the global Independent Newspapers group.

He was responsible for a national reporting team of 20 based in four bureaus. He also edited and contributed to its weekly technology page, and launched a financial and technology radio service supplying daily news bulletins to the national broadcaster, the South African Broadcasting Corporation, which were then distributed to some 50 radio stations across the country.

He was then transferred to San Francisco as Business Report's U.S. Correspondent to cover Silicon Valley, trade and finance between the US, Europe and emerging markets like South Africa. After serving that role for more than two years, he joined eWeek as a Senior Editor, covering software platforms in August 2000.

He has comprehensively covered Microsoft and its Windows and .Net platforms, as well as the many legal challenges it has faced. He has also focused on Sun Microsystems and its Solaris operating environment, Java and Unix offerings. He covers developments in the open source community, particularly around the Linux kernel and the effects it will have on the enterprise.

He has written extensively about new products for the Linux and Unix platforms, the development of open standards and critically looked at the potential Linux has to offer an alternative operating system and platform to Windows, .Net and Unix-based solutions like Solaris.

His interviews with senior industry executives include Microsoft CEO Steve Ballmer, Linus Torvalds, the original developer of the Linux operating system, Sun CEO Scot McNealy, and Bill Zeitler, a senior vice president at IBM.

For numerous examples of his writing you can search under his name at the eWEEK Website at


Submit a Comment

Loading Comments...
Manage your Newsletters: Login   Register My Newsletters

Rocket Fuel