feedback

Results tagged “pilot project”

Preamble: I'm Kevin Merritt, CEO of Socrata, a leading provider of open data services, based in Seattle, WA. While Socrata is focused squarely on helping government organizations share their data in human-comprehensible and machine-readable ways, I don't personally have a long tenure of experience selling software or services to the government. In full, transparent candor, the procurement process is the most challenging part of working with the government. It's complicated. So much so that many companies selling to the government have GSA contracting specialists to help navigate the process. As a taxpayer and businessperson, I'm in favor of making it simpler and more effective for innovative companies to do business with the government.

In March the General Services Administration (GSA) conducted a pilot project designed to make procurement a more transparent process. In the pilot, GSA submitted to industry an RFI for the next phase of evolution of data.gov. I participated in the pilot and want to share my feedback as a means to hopefully improve the overall procurement process.

Historically, GSA would issue a Request for Information (RFI) and industry would submit their responses in private. There is no back-and-forth communication between GSA and industry while the RFI response window is open. Without regard to GSA specifically, an RFI is often used to conduct basic market research and to help refine the requirements that will ultimately be included in a formal solicitation - the Request for Proposal (RFP).

The BetterBuy pilot project was novel in that it asked industry and interested individuals to submit their responses to the RFI, through a publicly editable wiki. It was the most transparent and collaborative RFI conducted by the federal government to date.

For those unfamiliar with wikis, they are web-accessible, collaborative content management systems. They allow anyone to create new content pages and even to edit the content created by others. Wikis work well for a few reasons:

  • General trust between and among the participants.
  • A community moderation system that identifies and corrects erroneous content.
  • A robust audit trail that shows who created (or changed) what.
  • Tools allowing site administrators to manage content revisions and versions.

In general, the BetterBuy wiki pilot was a success. Quite a few people participated and the discourse was civil. I believe the GSA data.gov team received valuable feedback, which will shape and influence the detailed requirements of the RFP. As importantly, I believe industry received some valuable feedback from the GSA data.gov team.

GSA would not have conducted the pilot unless there exists a serious intent to improve the procurement process. I believe their intention is sincere and genuine. To that end, I have some constructive feedback and suggestions for improving the process in the future.

  1. Don't map the structure of the RFI to the structure of the anticipated RFP. By doing so, the participant pool is somewhat restricted to those comfortable and/or familiar working within a prescribed format. What might be better is for the soliciting organization to loosely enumerate their questions and requested feedback, and broadly categorize those by subject area - background, physical architecture, logical architecture, security, functionality, accessibility, pricing, terms and conditions, etc.
  2. One of the potential benefits in a more open process is a level playing field. As such, provide an RFI platform that offers more transparency about the participants themselves. For example:
    1. Participants should use their full names and identify their affiliations;
    2. GSA administrators should be easy to identify;
    3. Industry submissions, including the possibility for multiple submitters per company, should be easy to identify;
    4. I suggest having three contributor profiles with corresponding, visually distinct badges - administrators, industry and interested citizens.
  3. The wiki site itself was a little sluggish throughout the response period, but especially in the last few hours leading up to the close of the response window. Make sure there are adequate resources so the site operates smoothly In future acquisition collaboration programs.
  4. The GSA itself should be more collaborative during the RFI response window. For example, if industry responds to an initial question in a way that doesn't provide the answer/clarification it's seeking, why not annotate the response with a follow-up question? It's this kind of back-and-forth dialog that represents a really open and transparent discussion.
  5. Consider using IdeaScale or similar crowd sourcing platforms instead of a wiki. Potential benefits include:
    1. A more natural environment for questions and answers, especially when it's anticipated that there will be multiple answers per question and/or multiple answerers per question;
    2. The ability to more elegantly categorize questions by subject area;
    3. Greater ease of use, improving participation;
    4. A clearer question and answer threading system allowing participants to both respond to official GSA questions/requests but to also reply, rebut and/or provide feedback on the answers provided by other participants;
    5. Visual indicators and/or badges identifying participant roles and their affiliations;
    6. The ability for participants to vote up/down good/bad ideas submitted by others;
    7. The ability for participants to suggest new questions that weren't initially thought of;
    8. The ability for administrators or participants to mark a response as the best answer;
    9. More transparency around the number of answers provided, new questions asked, top votes, etc. via statistics and analytics.
  6. Without regard for my 5th suggestion, if a wiki is the preferred approach for collecting industry feedback, take advantage of wiki "sections" which can be edited in isolation, more locally, without locking the entire page and without encountering edit collisions.
Unfortunately the current acquisition and procurement processes exclude many innovative companies - lacking the expertise, patience or desire - from providing much needed, best-of-breed technologies and services to the government. However, I believe the GSA is demonstrably serious about improving the acquisition process and the BetterBuy pilot is a big step in the right direction. We all can look forward to a more streamlined procurement process in the future.

In my earlier post, I commented on the "risk averse" nature of government acquisition. In our efforts to be fair to all, the manuals that we use grow longer and longer (e.g., the Federal Acquisition Regulations, supplemental Agency Regulations, Acquisition Policies, GAO decisions). This is an environment that has not embraced change and new technology, and for good reason.

When I asked around my office for volunteers to work on the pilot, not a lot of hands went up. A few brave souls eventually snuck over to my office to learn more, and finally we formed a team. We have a Contracting Officer, a Contract Specialist, a Project Manager, a few Technical Advisors, and an Acquisition Project Manager who will have to pull all of this together. Hopefully, I'll get to help steer all of this along without disrupting the rest of the organization's daily operations.

We spent the last two months evaluating the recommendations on BetterBuy, identifying the ideas that were feasible to implement, and working with our information technology support personnel to set up the infrastructure properly. We met with OMB, GAO, and other parts of GSA to discuss best practices for open collaboration, making decisions about things like user registration and authentication, roles and responsibilities for team members (e.g., who controls our twitter account, who can post). We are nearly ready with our wiki site for requirements definition. This process shines a bright light on established procedures and forces everyone to consider the value of the activity. Fun times!

My office (GSA FEDSIM) primarily works with other Federal Agencies on their procurements, but we also support a few internal GSA customers as well. We have been talking to these internal customers as the most likely candidates for the pilot project(s). We have two in our sights. Both are working with new technology and align well with the increased transparency through BetterBuy. We plan on launching the pilot in February, so stay tuned. . . . .


There are lots of great ideas on BetterBuy. Applying them to a new acquisition will be a challenging task for federal acquisition professionals, given the risk adverse starting point. GSA's efforts to pilot these ideas will be the topic of my blog.

Step 1 - Form the Team

GSA is forming the acquisition team for this BetterBuy pilot project, identifying the right skill mix of personnel interested in new technology and innovation. First on the agenda is finding a Contracting Officer who is already familar with web 2.0 tools (e.g., someone who uses Facebook, knows what a "tweet" is. . . . ). Once we do that, we move on to the more difficult task:

Step 2 - Talk to Legal

My first reaction to any significant change in acquisition process is that it introduces risk. It may (and should!) yield long term benefits, but we'll never get off the ground without thoughtful support from our legal counsel. Fingers are crossed for that first meeting. I'll bring a copy of the article from Federal Computer Week for them!

Step 3 - Find the Project

In many ways, this will be the easy part. GSA is moving quickly into web 2.0 tools. There will be no shortage of opportunities to find the project. We already have one or two candidates under consideration.

We are looking for feedback and thoughts. Please comment away with tips on how to navigate the process.

1