Wed, Jul
0 New Articles

Why Search Technology Is Important to Our Future

Collaboration & Messaging
  • Smaller Small Medium Big Bigger
  • Default Helvetica Segoe Georgia Times

In 2008, companies will be working harder to develop a culture of innovation in order to drive the market. Having access to internal and external information will be critical to this effort.


We worked through 2007, and, with the exception of a long and grisly war, it was a pretty good year. Looking ahead to 2008, we see signs that there may be an economic slowdown spawned in large measure by the sub-prime mortgage meltdown. Regardless of whether that comes to pass, the U.S. has assumed a huge national debt that will have to be paid off essentially by the nation's business output. You wonder why they keep letting immigrants into the country? Hey, we need as many taxpayers as we can get! Can people work any harder? Maybe, maybe not. But they sure could work a lot smarter.


James Todhunter, chief technology officer at Invention Machine, a leading innovation software company, argues that companies will have to do a better job of connecting the dots when it comes to implementing the ideas of their employees. Workers must come up with a regular stream of great ideas, and those ideas must make their way into the companies' products and services if the company expects to survive and thrive in a down market. He puts forth a number of principles necessary for companies to develop a culture of innovation, including one key element—that innovation starts at the top and management must "make its commitment to innovation clear and unambiguous." Others include these:


  • Provide innovation best-practices training.
  • Reward innovation contributors.
  • Invest in the right technology infrastructure to support innovation best practices.
  • Give innovation workers visibility into corporate objectives so their ideas support the company's direction.
  • Continuously communicate the value of innovation successes to clients and the company.
  • Practice innovation in everything workers do.
  • Make available highly precise concept retrieval tools that are integrated with innovation practices.

It is this last item that may be of most interest to IT administrators since what Todhunter is talking about here is today's generation of advanced search tools that can pull out information from unstructured as well as structured data. With the change in rules of civil procedure making companies responsible for producing relevant email when subpoenaed by a litigant, the need to be able to access the mountains of information stored in corporate computers takes on a whole new meaning. The regulation would be just another costly burdensome compliance requirement if it weren't for the fact that the information that is locked away on these computers could produce bottom-line benefits to the company if workers could only access to it. Needless to say, there are privacy issues, and I don't want my colleague snooping around notes I sent to my girlfriend. But in large corporations, there are gigabytes of data locked away in emails and other unstructured data repositories that could, if mined, produce benefits to both customers and the company. Knowing what is there, how valuable it is, and how to access it falls within the realm of IT.


The field of search technology has advanced significantly in the past year. If 2007 was a good year for anything, it was this, and MC Press Online has carried a number of stories about the product breakthroughs in this field during the past year. Todhunter points out that an important part of the innovation infrastructure is the "framework to leverage knowledge." By "knowledge," he means information both within the organization as well as outside the enterprise. And, he cautions, "don't make the mistake of assuming that a traditional knowledge management initiative will meet the specialized needs of your innovation workers." Designers, engineers, and scientists need better tools.


One initiative that is bearing fruit in giving knowledge workers better access to the vast repositories of information available to them is the open-source framework IBM created to help companies build new analysis technologies. Called Unstructured Information Management Architecture, or UIMA, the framework is designed to foster tools that will allow companies to realize more value from their unstructured information by discovering relationships, identifying patterns, and predicting outcomes. UIMA is now an open-source project at the Apache Software Foundation and already is used extensively to enable text analysis, extraction, and concept search capabilities among IBM's OmniFind enterprise search portfolio. The portfolio includes products with names like OmniFind Enterprise Edition, OmniFind Analytics Edition, and OmniFind Yahoo! Edition.


The latest tool to be announced by IBM is called IBM OmniFind Personal Email Search, or IOPES. For Lotus Notes and Outlook, it is a powerful "smart" search tool that allows people to retrieve information from their emails in a way that goes far beyond results produced by keywords. The software is powered by advanced algorithms that can interpret incomplete queries and find information such as phone numbers, people, meetings, presentations, documents, images, and more.


Available for free from IBM alpha Works, the software was the brainchild of Shiv Vaiyanathan, manager of unstructured information mining at IBM Research. Vaiyanathan, as the story goes, was searching for a phone number that a colleague had sent to him in an email. Fruitless attempts to plug in the sender's name and the word "phone" produced nothing but irrelevant, and somewhat frustrating, results. Vaiyanathan and a couple of colleagues began working on a better way, and they programmed in common search concepts such as dates, times, and phone numbers. A collaborative effort spanning IBM research labs in Almaden, California ; Haifa, Israel ; and Delhi, India , helped refine IOPES. The software was tested inside IBM by early adopters. The company has a program called Technology Adoption Program whereby employees try the products that come out of R&D and provide developers with their feedback. It's now available to users at large, and the hope is that, by offering it for free on alpha Works, IBM will continue to receive feedback. At some point, IBM may release it as a commercial product for searching intranets, at which point it may start charging for it.


Douglas Wilson, chief technology officer of Lotus, is apparently quite enthusiastic about IOPES, saying, "OmniFind Personal Email Search illustrates how IBM's advanced technology delivers the ability to quickly and easily access the precise information we need, exactly when we need it." Wilson notes that with gigabytes of email storage available to everyone, "email has evolved from a simple communication tool into a personal database where we retain vast amounts of valuable information."


Making the information locked away in a company's computers available to those who can use it effectively and learning how to leverage that information to benefit not only the company wherein it is contained, but also customers it is serving will be a significant challenge over the coming year. It will be up to IT administrators to evaluate and implement the tools that knowledge workers need to enhance their company's innovation results so that 2008 can be as successful as—or even more successful than—2007.

Chris Smith

Chris Smith was the Senior News Editor at MC Press Online from 2007 to 2012 and was responsible for the news content on the company's Web site. Chris has been writing about the IBM midrange industry since 1992 when he signed on with Duke Communications as West Coast Editor of News 3X/400. With a bachelor's from the University of California at Berkeley, where he majored in English and minored in Journalism, and a master's in Journalism from the University of Colorado, Boulder, Chris later studied computer programming and AS/400 operations at Long Beach City College. An award-winning writer with two Maggie Awards, four business books, and a collection of poetry to his credit, Chris began his newspaper career as a reporter in northern California, later worked as night city editor for the Rocky Mountain News in Denver, and went on to edit a national cable television trade magazine. He was Communications Manager for McDonnell Douglas Corp. in Long Beach, Calif., before it merged with Boeing, and oversaw implementation of the company's first IBM desktop publishing system there. An editor for MC Press Online since 2007, Chris has authored some 300 articles on a broad range of topics surrounding the IBM midrange platform that have appeared in the company's eight industry-leading newsletters. He can be reached at This email address is being protected from spambots. You need JavaScript enabled to view it..



Support MC Press Online


Book Reviews

Resource Center

  • SB Profound WC 5536 Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application. You can find Part 1 here. In Part 2 of our free Node.js Webinar Series, Brian May teaches you the different tooling options available for writing code, debugging, and using Git for version control. Brian will briefly discuss the different tools available, and demonstrate his preferred setup for Node development on IBM i or any platform. Attend this webinar to learn:

  • SB Profound WP 5539More than ever, there is a demand for IT to deliver innovation. Your IBM i has been an essential part of your business operations for years. However, your organization may struggle to maintain the current system and implement new projects. The thousands of customers we've worked with and surveyed state that expectations regarding the digital footprint and vision of the company are not aligned with the current IT environment.

  • SB HelpSystems ROBOT Generic IBM announced the E1080 servers using the latest Power10 processor in September 2021. The most powerful processor from IBM to date, Power10 is designed to handle the demands of doing business in today’s high-tech atmosphere, including running cloud applications, supporting big data, and managing AI workloads. But what does Power10 mean for your data center? In this recorded webinar, IBMers Dan Sundt and Dylan Boday join IBM Power Champion Tom Huntington for a discussion on why Power10 technology is the right strategic investment if you run IBM i, AIX, or Linux. In this action-packed hour, Tom will share trends from the IBM i and AIX user communities while Dan and Dylan dive into the tech specs for key hardware, including:

  • Magic MarkTRY the one package that solves all your document design and printing challenges on all your platforms. Produce bar code labels, electronic forms, ad hoc reports, and RFID tags – without programming! MarkMagic is the only document design and print solution that combines report writing, WYSIWYG label and forms design, and conditional printing in one integrated product. Make sure your data survives when catastrophe hits. Request your trial now!  Request Now.

  • SB HelpSystems ROBOT GenericForms of ransomware has been around for over 30 years, and with more and more organizations suffering attacks each year, it continues to endure. What has made ransomware such a durable threat and what is the best way to combat it? In order to prevent ransomware, organizations must first understand how it works.

  • SB HelpSystems ROBOT GenericIT security is a top priority for businesses around the world, but most IBM i pros don’t know where to begin—and most cybersecurity experts don’t know IBM i. In this session, Robin Tatam explores the business impact of lax IBM i security, the top vulnerabilities putting IBM i at risk, and the steps you can take to protect your organization. If you’re looking to avoid unexpected downtime or corrupted data, you don’t want to miss this session.

  • SB HelpSystems ROBOT GenericCan you trust all of your users all of the time? A typical end user receives 16 malicious emails each month, but only 17 percent of these phishing campaigns are reported to IT. Once an attack is underway, most organizations won’t discover the breach until six months later. A staggering amount of damage can occur in that time. Despite these risks, 93 percent of organizations are leaving their IBM i systems vulnerable to cybercrime. In this on-demand webinar, IBM i security experts Robin Tatam and Sandi Moore will reveal:

  • FORTRA Disaster protection is vital to every business. Yet, it often consists of patched together procedures that are prone to error. From automatic backups to data encryption to media management, Robot automates the routine (yet often complex) tasks of iSeries backup and recovery, saving you time and money and making the process safer and more reliable. Automate your backups with the Robot Backup and Recovery Solution. Key features include:

  • FORTRAManaging messages on your IBM i can be more than a full-time job if you have to do it manually. Messages need a response and resources must be monitored—often over multiple systems and across platforms. How can you be sure you won’t miss important system events? Automate your message center with the Robot Message Management Solution. Key features include:

  • FORTRAThe thought of printing, distributing, and storing iSeries reports manually may reduce you to tears. Paper and labor costs associated with report generation can spiral out of control. Mountains of paper threaten to swamp your files. Robot automates report bursting, distribution, bundling, and archiving, and offers secure, selective online report viewing. Manage your reports with the Robot Report Management Solution. Key features include:

  • FORTRAFor over 30 years, Robot has been a leader in systems management for IBM i. With batch job creation and scheduling at its core, the Robot Job Scheduling Solution reduces the opportunity for human error and helps you maintain service levels, automating even the biggest, most complex runbooks. Manage your job schedule with the Robot Job Scheduling Solution. Key features include:

  • LANSA Business users want new applications now. Market and regulatory pressures require faster application updates and delivery into production. Your IBM i developers may be approaching retirement, and you see no sure way to fill their positions with experienced developers. In addition, you may be caught between maintaining your existing applications and the uncertainty of moving to something new.

  • LANSAWhen it comes to creating your business applications, there are hundreds of coding platforms and programming languages to choose from. These options range from very complex traditional programming languages to Low-Code platforms where sometimes no traditional coding experience is needed. Download our whitepaper, The Power of Writing Code in a Low-Code Solution, and:

  • LANSASupply Chain is becoming increasingly complex and unpredictable. From raw materials for manufacturing to food supply chains, the journey from source to production to delivery to consumers is marred with inefficiencies, manual processes, shortages, recalls, counterfeits, and scandals. In this webinar, we discuss how:

  • The MC Resource Centers bring you the widest selection of white papers, trial software, and on-demand webcasts for you to choose from. >> Review the list of White Papers, Trial Software or On-Demand Webcast at the MC Press Resource Center. >> Add the items to yru Cart and complet he checkout process and submit

  • Profound Logic Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application.

  • SB Profound WC 5536Join us for this hour-long webcast that will explore:

  • Fortra IT managers hoping to find new IBM i talent are discovering that the pool of experienced RPG programmers and operators or administrators with intimate knowledge of the operating system and the applications that run on it is small. This begs the question: How will you manage the platform that supports such a big part of your business? This guide offers strategies and software suggestions to help you plan IT staffing and resources and smooth the transition after your AS/400 talent retires. Read on to learn: