OR/MS Today - October 2009



Practitioners & Projects


Buying Operations Research

How to successfully select and work with O.R. software and services providers.

By Brian Lewis


There is an active community of software and service vendors that is ready, willing and able to help you make the most of operations research. Perhaps your organization does not have an internal O.R. group. Or perhaps you do, but you are unable to solve every problem you face. Or perhaps you are the world's smartest O.R. group and you can solve every problem, but a little external help in the form of specialized software or consulting services makes your lives easier. This article reviews how to find and work with an O.R. vendor.

Deciding If You Need an O.R. Vendor


The Science of Better Web site lists five signs that indicate that you might benefit from O.R. [1]. In brief, these signs are:
  • you face complex decisions;

  • you're having problems with processes;

  • you're troubled by risk;

  • your organization is not making the most of your data; and

  • you need to beat stiff competition.

If at least one of these relates to your problem, then O.R. can probably help.

If your organization has internal O.R. professionals, you should talk to them first about your problem. They should be able to tell you if it can be solved in-house using existing resources. If you don't have access to internal O.R. professionals or if they decide they need or want external help, then you need an O.R. vendor.

Do your best to articulate your problem and start talking with an O.R. professional as soon as you have a basic problem definition. Spoiler alert: The problem you think you want to solve is often not the problem you really need to solve. Michael Kubica, president of Applied Quantitative Sciences, a firm that specializes in assisting life science and healthcare delivery systems make decisions under conditions of complexity and uncertainty, explains that companies initially do their best to articulate their problems and desired solutions using the language and approaches that they know. It is then the job of the O.R. professional to listen to the company and guide them in this articulation offering new language and new approaches when necessary.

You also need to come up with a basic definition of your desired solution. Joachim Schwarzkopf, MBA, Ph.D., a senior portfolio manager at a Fortune 200 pharmaceutical company, worked with me at Vanguard Software on a project to forecast and optimize their R&D project portfolio. His advice to companies is to have a clear idea upfront of what you want as a solution despite the fact that new ideas and changes will pop up during the project. Do you want a team of consultants to review your problem and write a report of their recommendations? Do you want an off-the-shelf modeling software that you can use to build your own models and run your own analyses? Do you want a custom-developed model or software solution? Do you want a one-off solution or an ongoing consulting relationship? Knowing what you want can help anchor the discussion with your O.R. vendor.

Remember that O.R. vendors have the benefit of having worked on hundreds of projects. They have probably seen similar problems to yours and therefore have the experience to guide your problem and solution definitions. Be open to this guidance. See where it takes your project. Sometimes, the final project scope is drastically different than the original. The last thing you want is to waste a lot of time and resources early in the project getting executive approval for a solution, getting a budget authorized, assembling a team, etc. before you know what that solution should really look like.

Finding an O.R. Vendor


Now that you have decided that you need an O.R. vendor, how do you find one? One O.R. manager and INFORMS member I talked with says that companies should do as thorough a job as possible on vendor selection.

Your first reaction is probably to Google something. Maybe "supply chain optimization" or "forecasting software." This is not a bad start and you will quickly find a range of vendors just through the natural search results. Definitely spend the time looking beyond the first few pages of results. Search engines are not perfect and great vendors don't always make it to the top. Don't be afraid of the pay-per-click (PPC) ads that appear around the natural search results. Vendors pay good money for these ads and clicking through to their site costs you nothing.

Besides Web searches, a number of online resources for finding O.R. vendors can be accessed through the O.R. Champions and Science of Better Web sites, respectively www.orchampions.org and www.scienceofbetter.org. These resources include the O.R. Resource Directory, a comprehensive guide to the software, vendors, consultants and publishers serving the O.R./M.S. community [2]; the special interest group guide, a list of links to active online communities focused on a variety of O.R.-related topics [3]; the O.R. Professional Search site, where you can search for software vendors, independent O.R. professionals and O.R. consultants at larger companies [4]; and the INFORMS membership directory itself [5].

Talk to vendors at conferences such as the INFORMS annual meeting or the INFORMS practice conference. Pitch your problem and see what they can do for you. Don't be shy. Vendors exhibit at conferences to be a resource for you. Treat these conversations as free, mini-consulting sessions. We vendors hope that you'll like what we have to say about solving your problem. In fact, it's no secret that we hope that you'll like it so much that you'll actually want to pay us for our software and/or services. But if not, just thank us for our time and walk away. You won't hurt our feelings. You can even take a free cookie, candy, pen or other random doodad with our logo on it. As an O.R. professional myself working for an O.R. software and services vendor, I can tell you that we just enjoy "talking shop."

Ask your professional network who they use for O.R. software and services. Fellow INFORMS members are a great resource for this type of information. Find out who they work with on their projects and what software products they use. See what they like and what they dislike. I tend to value personal references a great deal. They generally have little incentive to promote one vendor over another.

Selecting an O.R. Vendor


When it comes to selecting a vendor, Kathy Lange, senior director of SAS Analytical Consulting, offers the following: "If you are looking for the best company to provide O.R. software and services, my advice is to keep the big picture in mind as you choose. Start by assessing the overall fit of the vendor with your company considering the relationship you want to have with that vendor. Consider the quality of the software, the savvy of the services team, the reputation for technical support. You'll appreciate using proven solutions as you are tasked with making the right decisions."

A key part of Lange's advice, repeated by both O.R. vendors and the companies working with them, is to find a vendor that is a good fit. The definition of "good fit" will, of course, vary from company to company. The following adapted list from the Science of Better Web site gives you an idea of what to consider when evaluating whether an O.R. vendor is a good fit for you [6]. Does the vendor have:

  • Experience in your industry, shown by references and customer case studies?

  • Experience working with specific challenges similar to yours?

  • General experience in O.R. practice?

  • Knowledge of innovative and cutting-edge approaches, processes, and modeling techniques?

  • Knowledge of established best practices for your industry, application area or problem type?

  • General-purpose modeling tools or specialized software solutions that can help solve your problem?

  • External recognition and awards?

Remember that you are in control of the evaluation process. If you do not like a vendor's proposed solution, your interactions with them, their software and services model, or anything else for that matter, move on to another vendor. There are plenty of vendors that will want to help you.

Working with an O.R. Vendor


To formally define your relationship with your O.R. vendor, you need a contract or agreement. If you are purchasing an off-the-shelf software product, the agreement is usually quite simple. You agree to buy the software at a specific price subject to specific licensing terms. For more involved projects, you should consider the following key contract elements [6]: 1. clear description of the assignment (Statement of Work); 2. responsibilities of the O.R. vendor and of your organization; 3. deliverable materials — content, format, level of detail; 4. schedule for both the O.R. vendor and your organization, including project milestones; 5. project risks (if any) agreed upon by the O.R. vendor and your organization; 6. fees (time and materials vs. fixed cost); and 7. change-control procedures.

The statement of work is usually the most challenging to formalize. You might be able to define the work that you want your O.R. vendor to complete in excruciating detail. In this case you will have a very clear statement of work. However this is not the norm. Consider splitting your project into two phases. Use Phase 1 to scope the project and write a detailed statement of work and use Phase 2 to execute that statement of work.

Be sure the agreement includes a project plan with milestones and interim deliverables. Reaching milestones and implementing interim deliverables not only keep the project on track, they are important sources of motivation and dare are I say, fun. Everyone likes to finally see a scrubbed and structured data set, see an algorithm run for the first time, or pull up the first Web-based analysis report.

An important theme that emerged from my conversations concerned data. Alan Kosansky, president of Profit Point, a supply chain and optimization consulting company, best explained one of the biggest challenges of a project when he said, "Data, data, data. Getting accurate data that everyone in the customer organization believes and is willing to use for critical decisions." Companies have no shortage of data what with all their enterprise databases, ERP systems, business intelligence systems, and so on. It is no small task to determine the right data to use in a project and then to extract, structure and clean that data. Make sure you give your vendor access to the appropriate data managers and IT support staff to get and work with your data.

Regular interaction and exchange of ideas between your internal project team and your vendor promotes a dynamic solution. Joachim Schwarzkopf explains that an important factor to ensuring a project's success is iterative knowledge gain about the possibilities of a solution. You should regularly re-evaluate your solution during the project and make any changes you all agree will improve the end result.

Ending the Project


At some point, your project ends and the final solution is delivered. Reports are presented. Software is installed. Models are run. Decisions are made. Over time, you will determine if the project was a success.

Some projects are more easily evaluated than others, for example, operational optimization projects for production scheduling, supply chain design and transportation planning. These projects generally have clear before and after scenarios that can be compared. You might be able to say that you saved $2 million per year in transportation costs as a result of a new logistics optimization model. Other projects are more difficult to evaluate such as those for strategic planning, risk analysis or new product forecasting. Quite often calculating a demonstrable ROI for these types of projects is simply not possible, and the best you can say is that you feel more confident in your decision-making ability. Having talked with many business executives throughout many projects, confidence is crucial. And in the end, the value of a project is in the eye of the beholder.

I think a great way to know whether or not your project was a success is described by Kathy Lange. "I think the best part of the project is when the client calls you back to do another project," she says. "At that point, you know you've really helped them solve their problem and built a trusted relationship." This is the so-called "win-win situation," and you can't beat that.



Brian Lewis, Ph.D. (brian.lewis@vanguardsw.com), is vice president of Professional Services at Vanguard Software, an INFORMS Roundtable representative and chair of the INFORMS Public Information Committee.

References


  1. "5 Signs You Could Benefit from Operations Research," www.scienceofbetter.org/can_do/five_signs.htm.

    2. "The OR/MS Today Resource Directory," www.lionhrtpub.com/orms/RD/RD-intro.html.

    3. "Special Interest Groups," www.orchampions.org/resources/sig.htm.

    4. "O.R. Professional Search," www.scienceofbetter.org/database_search.htm?page=http://www.scienceofbetter.org/find/index.htm&the_title=Operations Research | Find an Operations Research Professional.

    5. "INFORMS Member Directory," www.informs.org/index.php?c=3&kat=Member+Directory .

    6. "Working with an O.R. Professional," www.scienceofbetter.org/start/professional.htm.






  • Table of Contents
  • OR/MS Today Home Page


    OR/MS Today copyright © 2009 by the Institute for Operations Research and the Management Sciences. All rights reserved.


    Lionheart Publishing, Inc.
    506 Roswell Rd., Suite 220, Marietta, GA 30060 USA
    Phone: 770-431-0867 | Fax: 770-432-6969
    E-mail: lpi@lionhrtpub.com
    URL: http://www.lionhrtpub.com


    Web Site © Copyright 2009 by Lionheart Publishing, Inc. All rights reserved.