1. Brief Bio

Dr. S.S. Iyengar is a computer scientist of international repute who has been a pioneer in multiple fields. Marked by his incredible record of success in the areas of world-class research, superb teaching, and excellence in community service, he has also significantly impacted industry, through his many discoveries and patents. His distinguished international and national research work has consistently been recognized by US government agencies, industry pioneers, and his research colleagues. His work has been featured on the cover of the National Science Foundation’s breakthrough technologies in both 2014 and again in 2016.

Dr. Iyengar has garnered multiple awards for his work and made fundamental contributions in a variety of areas that impact our lives today. His seminal contributions continue to be seen in places like Raytheon, Telcordia, Motorola the United States Navy, DARPA and other universities and research laboratories around the world.

  • Co-invented the Cognitive Information Processing (CIM) Shell (2010), a complex event processing architecture and engine which recognizes in response to complex patterns in mission-critical, real-time applications. The CIM Shell fuses disparate data streams (text & video) to create interactive sensing-to-cognition, inspection/visualization systems providing real-time monitoring, analysis and online diagnosis of manufacturing, agricultural and oil production. CIM sends an alert, then reconfigures on-the-fly to isolate critical events and fixed failures, unlike IBM’s Watson which only identifies failures.
  • Co-inventor of the Brooks-Iyengar Algorithm (1996) for noise tolerant distributed control which bridges the gap between sensor fusion and Byzantine fault tolerance providing an optimal solution to the fault event disambiguation in sensor networks. It provides a computationally inspired real-time fault-tolerant solution with applications in distributed control and software reliability.
  • Optimal Sensor Placement Technique (2002) for selected locations to provide protection in real-time applications. The seminal work late and intellectual foundation for new design policies/techniques in surveillance and telecommunications.

ram-iynegar-podium

2014_nsf-iucrc-compendium_2014-cover-showing_terrafly_and_alta

cover_of_the_2016_nsf_compendium_of_iucrc_technology_breakthroughs

Dr. Iyengar’s work has had a tremendous impact when applied to industries and real-world applications. In addition to the above areas, his foundational work continues to be implemented by government agencies and industry, including;

  • Tactical Environmental Support System (3rd Generation—TESS(3)) Surveillance and Oceanographic Sensing (1992), an implementation of the oceanographic expert system by the Naval Research Laboratory Detachment at Stennis Space Center (NRL – SSC). This system has applications to predict oceanographic features which cannot be observed because of cloud cover in the analysis of satellite imagery.
  • Sensor-Based Autonomous Mobile Robotics Dr. Iyengar’s extensive research in the fields of robotics, sensors, and artificial intelligence have continued from his early years at Oak Ridge National Laboratory and into his current work at Discovery Lab at Florida International University. His recent work is a urban surveillance telepresence robot for use by injured police officers,  demonstrating robotic technology assisting the disabled to return to work.
  • Computational Medicine, Founding Director of the Louisiana Biomedical Research Network, and development of autonomous intelligent systems for detecting radiation at Oak Ridge National Laboratory and the Jet Propulsion Laboratory, as well as discoveries in radiotherapy treatment of lung tumors, and development of an intraocular glaucoma monitoring device.

Dr. Iyengar is a member of the European Academy of sciences, winner of the Lifetime Achievement Award from ISAM-IIT (BHU), and is a Fellow of the Institute of Electrical and Electronics Engineers (IEEE), a Fellow of the Association of Computing Machinery (ACM), a Fellow of the American Association for the Advancement of Science (AAAS), and Fellow of the Society for Design and Process Science (SDPS). He was awarded the Satish Dhawan Chaired Professorship at the Indian Institute of Science (IISc), then Roy Paul Daniels Professorship at LSU. He has received the Distinguished Alumnus Award of the Indian Institute of Science. In 1998, he was awarded the IEEE Computer Society’s Technical Achievement Award and is an IEEE Golden Core Member.

wbtshowcase

One of Dr. Iyengar’s project along with Dr. Phoha(LA Tech) and Dr. Kannan(LSU) entitled “Fast Web Page Allocation on a Server Using Self-Organizing Properties of Neural Networks” was selected in World’s Best Technology Showcase in the year 2007. This is a highly competitive summit and other competitors were Los Alamos Labs, Johns Hopkins University, EPA , NASA and many other.


2. The Cognitive Information Processing (CIM) Shell

oil-rig
Industrial Applications

A Novel Architecture that is Changing the State-of-the-Art in Intelligent Systems

Dr. S.S. Iyengar is the co-inventor of the patented Cognitive Information Processing (CIM) Shell, a complex event processing architecture and engine which recognizes and responds to complex patterns in mission-critical, real-time applications (IEEE Comp. 2010) This new comprehensive computational framework created by Iyengar fuses disparate streaming data, like text and video, to create an interactive sensing-to-cognition, inspection and visualization system that provides real-time monitoring and analysis that can be applied to online diagnosis of manufacturing machines (LSU 2016-031), agricultural systems, and petroleum production,  The CIM Shell not only sends an alert but reconfigures on the fly in order to isolate a critical event and fix the failure, unlike IBM’s Watson which only identifies the failure.

techtarget-searchbusiness-analyticsThis Cognitive Information Shell was highlighted in an article in Business Analytics titled, “Cognitive computing for all Think about it”, article by Stephanie Neil featured in Business information.

The work being done with a university in India is focused on increasing specific crop productivity by using sensors to collect data on ground activity and a synthesis program to dynamically reconfigure in real time to adjust to environmental changes. The agriculture app provides actionable intelligence to scientists who use it to direct experiments and inform decision making.

Impact of the Cognitive Information Processing Shell

ames-nasa2

The CIM Shell has had significant impact in the market. Several companies are using the process which is licensed by AutoPredictiveCoding, LLC as noted in section 2.2. According to Spotcheck, the Total Addressable Market for this technology is predicted to be over $24.7 billion by 2019.

• Licensed by AutoPredictiveCoding, LLC’s
• Foundational technology for Spotcheck Technology’s online Diagnosis of Manufacturing Machines
• Technology incorporated into products sold by Novattec, Prophescy, SensorLytics, and others
• Used by NASA Ames research for satellite imagery and decision support via Nidia’s DeepSAT Video Analytics & Image program
• Used by USDA for decision support via the National Agricultural Imagery Project

According to ABIresearch, https://www.abiresearch.com/press/maintenance-analytics-to-generate-247-billion-in-2/.

2.1 How Does It CIM Work?

The following figures outline how the system operates and provides trend detection rules to interpret prior information and identify it as a complex event to determine associated risks and future operations.

Had the CIM Shell been integrated with the Deepwater Horizon infrastructure it would’ve interpreted prior maintenance incidents and concerns voiced by VPs engineers as complex events and magnified the associated risks, potentially averting the Deepwater Horizon disaster.

high-level-view-of-congnitive-information-management-shell
High-level view of Cognitive Information Management Shell

2.2 Business, Media and Academic References Demonstrating Impact and Use of CIM

spotcheck-video-imageSpotCheck solutions serve companies and institutions that rely on backup lines when their primary networks fail, or rely on remote, point-of-sale locations for revenue generation. SpotCheck Technology uses the system for online diagnosis of manufacturing machines. Their information and processes can be found at; http://spotchecktechnology.com. Their clients who are also using the technology are listed below.

AutoPredictiveCoding provides automated prediction model development and analytic engines for structured and unstructured content using latest research in data science across financial services, telecom, retail and healthcare verticals. The company offers its customers turnkey Data Science solutions that are outcome based. Their Analytics Engines automate predictive model building , increase scalability of unstructured data mining, provide sophisticated low latency pattern detection of image and video streams, and provide an out of the box integration of sensor data for verticals such as Agriculture. AutoPredictiveCoding is a current licensee of the CIM Shell technology.

Soft10 self-learning algorithms runs the whole process they create, select, predictself verify predictions. TEOCO leverages its expertise in ‘big data’ and ‘real-time’ capabilities to analyze and optimize network and business performance by taming the glut of telecom network, operational and business data. TreeMiner, INC is a highly scalable data mining solution using first vertical data mining solution. Zreyas Technology develops prototype solution in the Electronics and Sensor Technology domain leveraging a network of R&D partners and research labs across the US, and India.

autopredictivecoding-banner2

NovaTec is an independent, owner-managed IT consulting company, which supports customers of various industries in the successful implementation of projects in the IT environment. In addition to proven services complement your own, powerful software products in the areas of performance and license management and automation of IT services, our broad product range. NovaTec is a customer for the CIM Shell technology.

novatac-banner

Prophecy Sensorlytics affordable and patented solution lets you look into the future to predict machine malfunction and failure. Prophecy sensors are placed directly on your machines or components to automatically monitor condition. The sensor data transmits to an easy-to-install gateway and is then sent to cloud-based servers running powerful analytic software. Results are transmitted from the server to a user-friendly app where you will view real time machine condition and maintenance advice.Prophecy SensorLytics is a customer for CIM Shell technology.

  1. prophecy-solutionSensor
  2. Data Hub
  3. Router
  4. Cloud-based Servers
  5. Desktop Predictive Analytics Software
  6. User-friendly App
  7. Actionable Maintenance Advice

2.3 Total Addressable Market for the CIM Technology

ABIresearch estimates that the Total Addressable Market (TAM) for this CIM Shell technology as used by SpotCheck Technology for Online Diagnosis of Manufacturing Machines and currently being licensed by AutoPredictiveCoding LLC, with Novatec, and Prophecy SensorLytics customers using the technology was $9.1 billion dollars in 2014. DeepSAT: Video Analytics and Image is using the technology for video analysis with a Total Addressable Market (TAM) for this technology. ABIresearch predicts strong growth in both sectors for this licensed technology continuing through 2020.

abi-researchMaintenance Analytics to Generate $24.7 Billion in 2019, Driven by Predictive Maintenance and Internet of Things
ABI Research forecasts that revenues from maintenance analytics will total $9.1 billion this year. Following a CAGR of 22%, the market’s size will reach $24.7 billion in 2019, driven largely by adoption of predictive analytics and M2M connectivity. While the more advanced forms of maintenance, predictive and prescriptive, still account for just 23% of this year’s market, at the end of the forecasting period they will collectively represent 60% of all revenues.

2.4 Use of the CIM Shell Technology by NIVIDIA for NASA DeepSAT

DeepSAT, developed by NVIDIA provides video analytics and imaging using the CIM Shell technology. Nvidia is developing the DeepSAT technology through the NASA Ames Research Center.

deepsat

“DeepSAT—A Learning Framework for Satellite Imagery” is a journal article that explains the CIM Shell technology as it applies to satellite image classification. The article appeared in 2015 in the Association for Computing Machinery (ACM) magazine.  (2015 ACM. ISBN 978-1-4503-3967-4/15/11, http://dx.doi.org/10.1145/2820783.2820816.) [Basu, S., Ganguly, S., Mukhopadhyay, S., DiBiano, R., Karki, M., & Nemani, R. (2015, November). DeepSat: a learning framework for satellite imagery. In Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems (p. 37). ACM.]

deepsat-article-image
Click here to view full article

2.5 CIM shell technology used by USDA in the NAIP: National Agricultural Imagery Project

usda_logoNAIP: National Agricultural Imagery Project from USDA used CIM Shell technology in conjunction with other data to provide decision support. Additional information can be found at United States Department of Agriculture Farm Service Agency and NAIP fact sheet.

National Agriculture Imagery Program (NAIP)
naip_groundThe National Agriculture Imagery Program (NAIP) is administered by the U.S. Department of Agriculture’s Farm Service Agency (FSA) through the Aerial Photography Field Office (APFO) in Salt Lake City, Utah. NAIP acquires aerial imagery at a resolution of 1-meter ground sample distance (GSD) for the United States during the agricultural growing season, or “leaf on” conditions. The images are orthorectified which combines the image characteristics of an aerial photograph with the georeferenced qualities of a map.

2.6 CIM shell technology additional information and applications

How CIM Shell different from IBM’s Watson?

Cognitive computing for all? Think about it article by Stephanie Neil featured in Business Information 

The health care industry suffers from an ailment known as information overload. It’s a condition that makes it difficult for doctors and insurance providers to quickly determine the procedures that will be required and covered for each patient. The individual’s history, years of case files and clinical evidence must be considered -no small feat for a human. But it’s as easy as saying “aah” for Watson — IBM’s artificial intelligence computer system that processes natural language questions against a deep well of data to compute evidence-based answers in a matter of seconds. Read More >>

cim-shell-img3
Click here to read the full Article

S. Iyengar, Supratik Mukhopadhyay, Christopher Steinmuller, and Xin Li “Preventing Future Oil Spills with Software-Based event Detection“, IEEE Computer, pp: 76-78, August 2010.

Cognitive Information Management Shell (CIM Shell), a CEP system that can analyze complex events and activities and adapt rapidly to evolving situations in a wide variety of environments. By archiving past events and cross-referencing them with current events, the system can discover deep patterns and then act upon them. Agent-based techniques continually adjust CIM Shell’s parameters in near real time to adapt the system to changing environments, and human operators can easily add information to tweak the system, making goals easier to achieve. Had CIM Shell been integrated with the Deepwater Horizon infrastructure, it would have interpreted prior maintenance incidents and concerns voiced by BP’s engineers as a complex event and magnified the associated risks.

preventing-future-oil-spills-3

This article was featured in

computing-now-logo

For access to more content from the IEEE Computer Society,
see computingnow.computer.org.


3. The Brooks-Iyengar Algorithm

multi-sensor-fusion-fundamentals-and-applications-with-softwareThe Profound Contribution of the Brooks-Iyengar Algorithm

World Renowned Brooks – Iyengar Distributed Sensing Algorithm

The Brooks–Iyengar hybrid algorithm for distributed control in the presence of noisy data combines Byzantine agreement with sensor fusion. It bridges the gap between sensor fusion and Byzantine fault tolerance. This seminal algorithm unified these disparate fields for the first time. Essentially, it combines Dolev’s algorithm for approximate agreement with Mahaney and Schneider’s fast convergence algorithm (FCA). The algorithm assumes N processing elements (PEs), t of which are faulty and can behave maliciously. It takes as input either real values with inherent inaccuracy or noise (which can be unknown), or a real value with apriori defined uncertainty, or an interval. The output of the algorithm is a real value with an explicitly specified accuracy. The algorithm runs in O(NlogN) where N is the number of PEs: see Big O notation. It is possible to modify this algorithm to correspond to Crusader’s Convergence Algorithm (CCA), however, the bandwidth requirement will also increase. The algorithm has applications in distributed control, software reliability, and High-performance computing. Wikipedia

Application in DARPAS’s program demonstration with BBN, Cambridge Massachusetts, MURI, researchers from PSU/ARL, Duke, University of Wisconsin, UCLA, Cornell, and LSU.

pennstate-logo
In 2000, the DARPA program manager used two major demonstrations to showcase SensIT’s advances and document the ability of sensor networks to provide new capabilities. One
demonstration took place at the Twentynine Palms, California Marine Training grounds in
August 2000, the other took place at BBN offices in Cambridge, Massachusetts in October 2011. Dr. Gail Mitchell of BBN coordinated this work for BBN, DARPA’s SensIT integration contractor. Both demonstrations used the Brooks-Iyengar fusion approach to combine sensor readings in real-time. Acoustic, seismic, and motion detection readings from multiple sensors were combined and fed into a distributed tracking system. The first deployment was effective but noisy. The second demonstration built on the success of the first testing California. uofwis-mad-logoAn improved outfielder algorithm was used to determine which node was best situated to continue existing tracks. This work was an essential precursor to the Emergent Sensor Plexus MURI from Penn State Applied Research Laboratory (PSU/ARL) with Dr. Sashi Phoha as PI. In that MURI, researchers from PSU/ARL, Duke, University of Wisconsin, UCLA, Cornell, and LSU extended SensIT’s advances to create a practical and survivable sensor network applications.

  • Unified the fields of Fault Tolerance and Sensor Fusion—revolutionary contribution!
  • Incorporated by DARPA into SensIT technology and its demonstrated advances.
    • Allowed combine sensor readings in real-time
    • Combined acoustic, seismic, and motion detection readings from multiple sensors;
    • Fed into a distributed tracking system
  • Incorporated into modern-day LINUX & Android OS
    • Combines data in fault tolerance
    • Used by 99% of the world’s top supercomputers
    • 79% of all smartphones worldwide
    • 100% of users accessing the Internet

3.1 Business, Media and Academic References Demonstrating Impact and Use of the Brooks-Iyengar Algorithm

linux-logoApplication of this algorithm in modern day Linux operating system for combining data in fault-tolerance.(MINIX)

In 1996, Iyengar’s group, in collaboration with Brooks and with funding from Oak Ridge National Laboratory and the office of Naval Research, Invented a method of fault tolerance modeling that offers a computationally inspired real-time management solution. This work has emerged in new versions of real-time extensions to Linux Operating Systems. Many of these algorithms were used and installed in the RT Linux Operating System. They are now working on formal model verification by incorporating the algorithms into a new embedded kernel for robotic applications.

The profound contribution of the Brooks-Iyengar Distributed Computational Sensing work has enhanced new real-time features by adding fault tolerant capabilities.

V. Kumar, “Impact of Brooks-Iyengar DistributedSensing Algorithm on Real Time Systems,” in IEEE Transactions on Parallel and Distributed Systems, vol. 25, no. 5, pp. 1370-1370, May 2014.

In this paper we evaluate the merit of Brooks-Iyengar distributed sensing algorithm and highlight its impact on cost-effective processing of real-time sensor data stream. We discover that it has a long-lasting impact, not only on sensor networks, but also on computer operating systems. We believe that as we learn more about the usefulness of this algorithm, it will become an essential component of system that use sensors in some form.

Click here to read full article
Click here to read full article

3.2 Select Letters

Carleton University is developing a formal model verification by incorporating the algorithms into a new embedded kernel for robotic applications.

Carleton Letter
Click to view full letter

raytheon-logo…the impact of this work has been significant. The Brooks-Iyengar Algorithm makes it possible to extract reliable data from sensor networks when some sensors are unreliable, thus adding a fault tolerant aspect. Unreliable sensor data are typically the case in systems that Raytheon develops for its customers, so applications of the algorithm made Raytheon and its customers more successful without increased investment in improved sensor reliability. This saved money, always important in today’s increasingly budget conscious environment.
…the Brooks-Iyengar algorithm continues to have significant impact where it is applied to Raytheon’s programs.

Intelligence, Information and Service Raytheon

Citation from Raytheon Company

Read full letter here
Read full letter here

Telcordia technologies, Inc., also incorporated the Brooks – Iyengar Algorithm into their work.

telcordia-logo…The seminal work of professor Iyengar and his colleagues on sensor networks infrastructure constitutes a foundation for sensor placement and optimization of information obtained from sensor networks. The ideas and algorithms introduced by Iyengar et al. Played an important role in Telcordia patent 019576 entitled “Method for placement of sensors for Surveillance” and Motorola patent 7688793 entitled, “Wireless sensor node group affiliation method and apparatus,” both of which build up upon his pioneering work.
I believe that professor Iyengar work on sensor deployment, coverage, and surveillance has led to major advances in network technologies….

~ Marek Rusinkiewicz Vice President for research and General Manager of Telcordia

CITATION FROM TELCORDIA TECHNOLOGIES INC.

Click to view full letter

3.3 The Brooks-Iyengar Algorithm Demonstrates Potential for Millions of Dollars of Future Market Growth

boeing-logoIyengar’s work has had a significant impact in industrial applications/ research, and continuing scientific research. Many new ideas have been spawned from his seminal work, resulting in a variety of new innovations by industries such as Motorola, Telcordia, Boeing, and even new chip-design at universities. New applications from industrial research are ongoing, each resulting in millions of dollars of market growth.

The intellectual advancement of his ideas has been incorporated into over 23 Ph.D. thesis and other new thesis and dissertations resulting in scientific discoveries around the world. His work has impacted thesis in Germany, the United States, and China. His foundational work has also resulted in innumerable funding opportunities provided by the National Science Foundation to continue to advance research in this significant area.

pastedgraphic-34. The Optimal Sensor Placement Technique

The Seminal Contribution of the Optimal Sensor Placement Technique

Co-inventor of an optimal sensor placement technique relating to a limited number of sensors at selected locations in order to provide protection to all locations in real-time applications, which has been included in patents by Telcordia and Motorola, as well as other companies. (IEEE Computers, 2002. This groundbreaking work has laid an intellectual foundation for designing policies and techniques in many areas of real-time applications from surveillance systems to telecommunications systems.

4.1 Optimal Sensor Placement Technique Impact on Industry

Iyengar’s work has had a significant impact in industrial applications/ research, and continuing scientific research. Many new ideas have been spawned from his seminal work, resulting in a variety of new innovations by industries such as A Novel Architecture that is Changing the State-of-the-Art in Intelligent Systems, Telcordia, Boeing, and even new chip-design at universities. New applications from industrial research are ongoing, each resulting in millions of dollars of market growth.

The intellectual advancement of his ideas has been incorporated into over 23 PhD thesis and other new thesis and dissertations resulting in scientific discoveries around the world. His work has impacted thesis in Germany, the United States, and China. His foundational work has also resulted in innumerable funding opportunities provided by the National Science Foundation to continue to advance research in this significant area.

4.2 Business, Media and Academic References Demonstrating Impact and Use of the Optimal Sensor Placement Technique

telcordia-logoTelcordia Technologies, Inc., also incorporated the Optimal Sensor Placement Technique into their work.

Review reference letter from Telcordia Technologies, Inc.

Millions of dollars of market growth. Iyengar’s work has had a significant impact in industrial applications/ research, and continuing scientific research. Many new ideas have been spawned from his seminal work, resulting in a variety of new innovations by industries such as Motorola, Telcordia, Boeing, and even new chip-design at universities. New applications from industrial research are ongoing, each resulting in millions of dollars of market growth.

Grid coverage for surveillance and target location in distributed sensor networks,”

K Chakrabarty, SS Iyengar, H Qi, E Cho, “Grid coverage for surveillance and target location in distributed sensor networks,” IEEE transactions on computers 51 (12), 1448-1453

grid-coverage-sensorClick to view full research

“Distributed Bayesian algorithms for fault-tolerant event region detection in wireless sensor networks,” appeared in IEEE Transactions on Computers 53 (3), 241-250, and further explains the groundbreaking Optimal Sensor Placement technology.

pastedgraphic-24.2.1 Highly Citied Papers

990 citations: Sensor deployment and target localization based on virtual forces – Y Zou, K Chakrabarty, IEEE INFOCOM, 2003

473 citations: Sensor deployment and target localization in distributed sensor networks – Y Zou, K Chakrabarty, ACM Transactions on Embedded Computing Systems, 2004

908 citations: Grid coverage for surveillance and target location in distributed sensor networks – K Chakrabarty, SS Iyengar, H Qi, E Cho, IEEE transactions on Computers, 2002

573 citations: Sensor placement for effective coverage and surveillance in distributed sensor networks – SS Dhillon, K Chakrabarty, Wireless Communications and Networking, 2003

359 citations: Sensor placement for grid coverage under imprecise detections – SS Dhillon, K Chakrabarty, SS Iyengar, Information Fusion, 2002

us08019576-20110913-d000014.2.2 Optimal Sensor Placement Technique Industry Impact: Patents

8019576: Method for placement of sensors for surveillance – Issued: September 13, 2011, Assignee company: Telcordia.

7688793: Wireless sensor node group affiliation method and apparatus – Issued: March 30, 2010, Assignee company: Motorola.

7676805 B2: Wireless sensor node executable code request facilitation method and apparatus – Issued: March 9, 2010, Assignee company: Motorola.

8131839 B2: Method and apparatus for resource assignment in a sensor network – Issued: March 6, 2012, Assignee company: Motorola.

WO 2015132691 A2: Method for deploying sensors – September 11, 2015.

US 7480395 B2: Decentralized detection, localization, and tracking utilizing distributed sensors – Issued: January 2009.

US 7091902 B2 (Xerox Corporation): Systems and methods for characterizing the coverage of ad hoc sensor networks – Issued: August 2006.

4.2.3 Optical Sensor Placement Technique Documented Impact on Research at Boeing Corporation

Mattikalli, R. Fresnedo, R. Frank, P. Locke, S. Thunemann, Z. Optimal Sensor Selection and Placement for Perimeter Defense, 2007.

dod-logo4.2.4 Documented Impact on Research at Department Of Defense

Capt. S. Hynes and N. S. Rowe, “Multi-Agent Simulation for Assessing Massive Sensor Deployment”, Article at Naval Postgraduate School, 2004

We present the design and implementation of a multi-agent simulation that models deployment and coverage of sensors performing collaborative target detection. The focus is on sensor networks with enough sensors that humans cannot individually manage each. Experiments evaluated both known and novel deployment algorithms, and considered effects of the sensor type, number of sensors deployed, presence of obstacles, and mobility of the sensors.

4.2.5 Impact on Graduate Theses and in Diverse Areas (Including International Impact) 

  • Integrated Circuit Design: On-Chip Thermal Sensor Placement, M.S. Thesis at UMass-Amherst (Yun Xiang), 2008
  • Wireless Networks: Secure Localization and Node Placement Strategies for Wireless Networks, PhD Thesis at Auburn University (Santosh Pandey), 2007
  • purdueu-logoRobotics: Energy-Efficient Mobile Robots, PhD Thesis (Yongguo Mei) at Purdue University (2007)
  • Sensor Management: Global Sensor Management: Allocation of Military Surveillance Assets, PhD Thesis at NC State University (Kristin Arney), 2008
  • Wireless Sensor Networks: Effiziente Kommunikation und Optimierung der Knoten-Positionierung in drahtlosen Sensornetzen unter Ausnutzung räumlicher Korrelationen (in German), PhD Thesis at Technical University of Aachen, Germany (Frank Odewurtel), 2011
  • Distributed Self-Deployment in Visual Sensor Networks,(MS thesis), Christopher Allan Beall August 2006, The University of Tennessee, Knoxville.
  • Energy-effient coverage with wireless sensors(PhD thesis) ,Guanqun Yang,Iowa State University,2010
  • Intelligent deployment strategies for passive underwater sensor networks, PhD thesis), Rochester Institute of Technology, Erik Golen,2009,
  • Collaborative Area Monitoring Using Wireless Sensor Networks with Stationary and Mobile Nodes, Theofanis P. Lambrou, PhD thesis, University Of Cyprus.
  • Self-Organizing Hybrid Sensor System with Distributed Data Fusion For Intruder Tracking and Surveillance, RAVISHANKAR PALANIAPPAN M.S. University of Central Florida, 2003
  • Collaborative Solutions to Visual Sensor Networks, Mahmut Karakaya, (PhD Thesis), The University of Tennessee, Knoxville,2011.
  • Cargo Monitoring: Optimal Communications Systems and Network Design for Cargo Monitoring, PhD Thesis at University of Kansas (Daniel Fokum),
  • An Energy-Efficient Distributed Algorithm for k-Coverage Problem in Wireless Sensor Networks, Chinh Trung Vu,(MS thesis), Georgia State University,2007.
  • MULTI-AGENT SIMULATIONS (MAS) FOR ASSESSING MASSIVE SENSOR COVERAGE AND DEPLOYMENT, Sean E. Hynes, (MS thesis), Naval Postgraduate School, 2003.
  • Human Activities Space: A Multi Sensor System for a Human Activities Space Aspects of Planning and Quality Measurement, Blekinge Institute of Technology, Sweden, Licentiate Dissertation Series, 2008.
  • Structural Health Monitoring: Identification of Damage Using lamb Waves, Springer Book volume 2009.
  • Dimensional Measurement: Distributed Large-Scale Dimensional Metrology: New Insights (book).

In the area of sensor networks narrowly defined, the citation below used in over 23 PhD thesis.

Chakrabarty, K., S. S. Iyengar, H. Qi, and E. Cho. 2002. “Grid Coverage for Surveillance and Target Location in Distributed Sensor Networks.” IEEE Transactions on Computers 51(2):1448-1453.

4.2.6 Impact on National Science Foundation (NSF) Grants

nsf-logo1Several NSF grants were awarded to researchers who have built upon and leveraged the pioneering work on sensor deployment and minimalistic sensor networks. Here is a snapshot of some these grants:

Award Number: CNS-1054935 (“CAREER: A Theoretical Foundation for Achieving Sustainability and Scalability in 3D Wireless Sensor Network Deployments”)

Award Number: CNS- 1152134 (“Optimal Surface Gateway Deployment for Underwater Acoustic Sensor Networks”)

Award Number: 0449309 (“Collaborative Signal and Information Processing in Sensor Networks”)

Award Number: CNS-1149611 (“SensorFly: Minimalistic Dynamic Sensing and Organization in Groups of Semi-Controllable Mobile Sensing Devices”)


5. Tactical Environmental Support System (Surveillance and Oceanographic Sensing)

don-logoIn the fields of surveillance and oceanographic sensing, Dr. Iyengar’s impact has been enormous. His foundational research provided the basis for a much larger effort involving U.S. Navy laboratories, industry partners, and leading universities to construct next-generation U.S. Navy surveillance systems. His work was the centerpiece for the Navy’s pioneering efforts in developing computerized image analysis system leading to the first fully automated U.S. Navy system for interpretation of satellite images of the ocean. his work on image analysis is the fundamental framework for today’s operational U.S. Navy systems. Expanding the frontiers of image analysis science, and are captured in his book, Advances in Distributed Sensor Integration: Applications in Theory, published in 1995 and his new, soon to be published work, The Design and Analysis of Algorithms for Processing Digital Satellite IR images.

5.1 Contributions to U.S. Navy

Dr. Iyengar’s research on image processing systems was used in 1988-93 by the U.S. Navy as a centerpiece of architecture. Dr. Iyengar addressed the problem of linking of low level features of oceanographic objects. Without useful result in this key area the work of other laboratories involved with this project could not have been integrated into a working prototype system. In three years Dr. Iyengar’s research served well as the centerpiece of his pioneering efforts in computerized image analysis systems.

5.3 Select Letters

…Prof. Iyengar’s use of non-linear probabilistic relaxation to perform feature labeling was innovative and well executed. His work was a key factor leading to the first fully automated interpretation of a satellite image of the ocean in 1989…

Ronald Holyer Head, Computer Sciences Section, US Naval Research Office

Click here to view letter
Click here to view letter

naval-oceanographic-and-atmospheric-research-laboratoryThe Naval Research Laboratory (NRL-SSC) has developed an expert system with a rule base that “knows” about the evolution of mesoscale features in the Gulf Stream region of the North Atlantic. The expert system uses rules that describe the features’ kinematics to evolve an earlier environment. Hence,it is proposed as a candidate for implementation on the Tactical Environmental Support System, third generation (TESS(3)).

Read the full documentation on Oceanographic Expert System: Potential for TESS(3) Applications

ornl-logo6. Contributions to Sensor-Based Autonomous Mobile Robotics: Theory, Research, and Impact

Jointly with Department of Energy Oak Ridge National Laboratory

During the last four decades, Professor Iyengar has been laying a foundational approach by combining the deep mathematical insights into algorithmic foundations with an equally deep view of practical considerations in many areas. Robotics is one of the areas that benefited from his keen insights and solid, rigorous and elegant solutions, which has had an impact in technological advances and for real-world applications. This impact of his contributions can be documented both in industrial applications with a research focus. Translation of his work into the applications and its commercial impact has been significant.

Very few mobile robot manufacturing companies existed in the 1980s in the U.S. (or elsewhere), and indeed, federal agencies had to seed in-house efforts for building mobile robots needed for their specific mission needs. U.S. Department of Energy (DOE) launched an initiative at Oak Ridge National Laboratory (ORNL) to build mobile intelligent robots for autonomous operation in radiation-prone environments, which could potentially be too dangerous for human operations. Dr. Iyengar, jointly with Oak Ridge National Laboratory researchers, started the development of these intelligent robots (HERMES I, II, and II series of experimental robots) in which his invention in designing real-time algorithms for mapping terrain to facilitate the monitoring and processing of asynchronous information.

ieee-computer-cover_robotics_sectionFurthermore, the enhanced conflict resolution strategies and rule interruptibility features of the asynchronous production systems for monitoring the autonomous robot in a real-time environment were all a part of his invention and discovery on the HERMES series robots. His contributions represent a significant increase in research capabilities at ORNL-CESAR robotic research.  His impact and contribution in HERMES at the Center for Engineering Systems for advanced Research at ORNL represents a foundational increase in research capabilities for the DoD CESAR Laboratory.

His innovations and algorithms developed are currently preserved at the Archive Facilities at ORNL. 

Dr. Iyengar’s research in the fields of robotics, sensors, and artificial intelligence have continued from his early years at Oak Ridge National Laboratory and into  his current work at Discovery Lab at Florida International University, where he is working on the New future of law enforcement in the form of a telepresence robot for use  by injured police officers to maintain their presence on the city streets and within the law enforcement career field, when they may otherwise have been medically retired.

6.1 History at Oak Ridge National Laboratory (ORNL) Robotics

In the early 1980’s the U.S. Department of Energy (DOE) launched an initiative at Oak Ridge National Laboratory (ORNL) to build mobile robots for autonomous operation in radiation-prone environments, which could potentially be too dangerous for human operations. As the then electro-mechanical devices were being built at ORNL, it became apparent that sophisticated navigation systems were essential for the success of their missions. The problem was further compounded by the unstructured DOE environments, e.g., after an incident, and the limited reliability of sensors, namely, ultrasonic and low-resolution cameras. Many prominent researchers of the day believed at the time that these problems were not amenable to rigorous analytical treatment. Others, however, disagreed. ONRL leaders began calling upon those who disagreed to see what could be done. To begin the research, they called upon young pioneers in the then, emerging robotics field. One of those called was Dr. S.S. Iyengar. Under the Center for Engineering Systems Advanced Research (CESAR) program. Directed by Dr. Chuck Weisbin and Dr. Jacob Barhen others, he, along with other emerging scientists, was challenged to meet three key goals in developing autonomous robotic systems. The systems needed to be intelligent enough to;

  • Make decisions about actual and potential radiation leaks
  • Decide on courses of corrective actions through onboard, real-time path planning with sensor feedback and,
  • Execute radiation mitigation and clean-up

Prof. Iyengar developed pioneering methods that provided sound analytical and computational basis for developing navigation algorithms in environments with significant unknown parts using the unreliable sensors. Prior to his work, it was unclear if such rigorous frameworks can be developed at all for these complex problems.

Radiation leak decisions

With sponsorship from DOE, Dr. Iyengar worked closely with ORNL team to develop and implement sensor-driven terrain model acquisition and incidental learning methods for mobile robot navigation.

The Hostile Environment Robotics Machine Intelligence Experiment Series (HERMES I, II, III) was developed as a series of experimental mobile robots as testbeds for developing and demonstrating new algorithms for real-time path planning with sensor feedback for decisions for navigating in unstructured environments to determine potential radiation leakage.  The HERMIES-IIB robot in the CESAR lab at ORNL is used in research related to vision, multi-sensor integration, coordinated arm movement, path planning, parallel algorithms, and learning. Iyengar also developed a visual object recognition system for HERMIES. This system was implemented on a NCube system, which is an MIMD hypercube parallel computing system. In general, the input to the object recognition system is an image containing one or more instances of the known different types of obstacles, and produces the output location(s) of the obstacle(s) relative to the cameras. Based on assumptions about the known geometry of the obstacles, the viewing conditions, the relevant range of viewing distances and the image resolution needed, the system he developed is able to recognize obstacles by rough, rectangular outlines in the image. The object recognition system used Hough transforms to find rectangular outlines in the image, and then used a sequence of constraints to eliminate those outlines which could not be due to obstacles. hermies-iib-2

Through a series of works spanning more than a decade, he published a number of pioneering papers in IEEE Transactions on Robotics and Automation and International of Robotics Research, which laid the foundations many of the recent advances in this area. These algorithms discovered in this research have now been advanced and included in nearly all autonomous robots.

6.2 Terrain Mapping Methods

Of particular relevance are the terrain mapping methods he developed, which enabled autonomous robots to cover specific geographic areas. More generally, in this area of computational research, i.e., aspects of robot motion planning in unknown terrains, he is among the first researchers to formulate efficient tractable algorithms and data structures, and implement them on practical systems while at ORNL.  His work titled “Trajectory Planning of Robot manipulators in noisy work spaces using Stochastic Automata” published in the International Journal of Robotics Research, Apr 1991 (MIT Press) has been cited extensively by researchers all over the world.

6.3 Market for the Terrain Mapping Technology

irobot_roomba_780Iyengar’s concept has today developed into diverse concepts such as the Roomba vacuuming robots, which are deployed as labor saving devices in households throughout the country. His technology was of decisive importance in developing robots to detect and defuse improvised explosive devices (IED) for use by U.S. military in Iraq and Afghanistan through small, mobile robots.  Other recent developments incorporating his technology include self-driving cars using multiple sensors to travel across our highway systems.  While the sensors have become much more sophisticated, the origins of the underlying methods can be traced back to his original research discoveries as outlined in his published papers.

military_robot_being_prepared_to_inspect_a_bomb

6.4 Economic Impact of Sensor-Based Autonomous Mobile Robotics

In a research study published in 2016[1], researchers recently indicated autonomous vehicles and intelligent robots as one of the hottest emerging technologies driving corporate strategies and industry policies. Economically, this has already translated into a more than $640 million per year commercial revenue stream, which is growing at a rate of nearly 10 percent per year.

Detailed References on the Intelligent Mobile Robot

The following articles were published as a part of Dr. Iyengar’s extensive work.

Kai Storjohann & Eric Saltzen, “Adapting Sensory Data for Multiple Robots Performing Spill Cleanup,” Office of Basic Energy Sciences, Oak ridge national Laboratory, September 1990

This paper describes a possible method of converting a single performing robot algorithm into a multiple performing robot algorithm without the need to modify previously written codes. The algorithm to be converted involves spill detection and clean-up by the HERMIES-III mobile robot. In order to achieve the goal of multiple performing robots with this algorithm, two steps are taken.

intellgent-machine
Sonar Recognition of Simple Obstacles

Charles R. Weisbin, “Intelligent-Machine Research at CESAR,” AI Magazine Volume 8, Number 1, 1987

Many technologies of interest to the Department of Energy (DOE) require hazardous operations in which intelligent machines could be used to advantage. Closest to home is the handling of radioactive material around reactors and processing plants, but similar problems arise with explosives and other hazardous chemicals. Underground mining puts humans at risk on a large scale, and underwater operations from exploration to maintenance of equipment and, eventually, to seabed mining have a similar potential.

Deanna L. Barnett, G. de Saussure and F. G. Pin, “Robot Navigation Research at CESAR,” Center for Engineering Systems Advanced Research, Oak Ridge National Laboratory

A considerable amount of work has been reported on the problem of robot navigation in known static terrains. Algorithms have been proposed and implemented to search for an optimum path to goal, taking into account the finite size and shape of the robot. Not as much work has been reported on robot navigation in unknown, unstructured, or dynamic environments.

Edited Books

S. S. Iyengar and A. Elfes, (ed), “Autonomous Mobile Robots: Perception, Mapping, and Navigation,” Volume 1, IEEE Computer Society Press, October 1991.

S. S. Iyengar and A. Elfes, (ed), “Autonomous Mobile Robots: Planning, Control, and Architecture,” Volume 2, IEEE Computer Society Press, October 1991.

Footnotes:
[1] Yun, JinHyo Joseph, DongKyu Won, EuiSeob Jeong, KyungBae Park, JeongHo Yang, and JiYoung Park. "The relationship between technology, business model, and market in autonomous car and intelligent robot industries." Technological Forecasting and Social Change 103 (2016): 142-155.

7. Biomedical Engineering and Medicine

Innovative interventions for challenging medical conditions
Innovative interventions for challenging medical conditions

Dr. Ram Iyengar has been elected to the 2017 Class of the College of Fellows of the American Institute for Biological and Medical Engineering. Only 2% of researchers conducting biomedical/bioengineering research world-wide have been inducted with this year only 60% of the nominated candidates made it to the final ballot.

Dr. Iyengar’s innovation and research accomplishments over the last four decades have had a major impact in Computational Sciences with applications in Medicine, Biological and Medical Imaging. A role model in multiple fields, Dr. Iyengar’s innovations, inventions and commercialization activities have significantly impacted Computer Science, Biomedical Engineering, and Medicine, as well as society as a whole. Dr. Iyengar was a Roy Paul Daniel Professor and Chairman of the Computer Science Department at Louisiana State University for 32 years, where he was responsible for making the LSU computer science program one of the top 10 of 126 colleges and universities in the NRC rankings. He was also the founding Director of the Louisiana Biomedical Research Network.

Dr. Iyengar’s innovation and research accomplishments over the last four decades have had a major impact in Computational Sciences with applications in Medicine, Biological and Medical Imaging. A role model in multiple fields, Dr. Iyengar’s innovations, inventions and commercialization activities have significantly impacted Computer Science, Biomedical Engineering, and Medicine, as well as society as a whole. Dr. Iyengar was a Roy Paul Daniel Professor and Chairman of the Computer Science Department at Louisiana State University for 32 years, where he was responsible for making the LSU computer science program one of the top 10 of 126 colleges and universities in the NRC rankings. He was also the founding Director of the Louisiana Biomedical Research Network.

During his tenure at Oakridge National Lab, he was one of the key leaders responsible for initiating and coordinating a program in autonomous intelligence systems for detecting radiation during the 1980s. He continued his work at the Jet Propulsion Laboratory in the 1990s. He has been a visiting Professor at various institutions, including, the University of Paris, Indian Institute of Science, and other universities in China, Korea, and other universities around the world.

Dr. Iyengar’s inventions which have significantly impacted the field of biomedical engineering and medicine include his newly patented glaucoma detection device. In addition, Dr. Iyengar has been involved in solving complex problems in early detection of lung cancer, by joining colleagues at Southwestern Medical School in Dallas.

7a. Computational Measures for Predicting DNA Mutation

wavelet-transform-in-cancer-genome-analysis
A sample procedure of applying wavelet transform in cancer genome analysis.
Click to read full article

Dr. Iyengar has developed computational measures for predicting DNA mutations during cancer Evolution, using wavelet analysis in cancer genome research, and designing smart biomarkers for bioremediation.

Juan C Martinez, Nelson L Jimenez, Tao Meng, S.S. Iyengar. “Predicting DNA mutations during cancer evolution.” International Journal of Bioinformatics Research and Applications, Vol. 11, No. 3, pp. 200-218, 2015.

Bio-systems are inherently complex information processing systems. Their physiological complexities limit the formulation and testing of a hypothesis for their behavior. By processing the sequencing data before relapse time, we tested our framework by predicting the regions of the genome to be mutated at relapse time and, later, by comparing our results with the actual regions that showed mutations discovered by genome sequencing at relapse time.  This high performance from our proposed framework opens new research opportunities for bioinformatics researchers and clinical doctors.

computational-biology-and-bioinformatics

Soliman AT, Meng T, Chen SC, S. S. Iyengar, Puneeth Iyengar, Yordy J, and Shyu M.L., “Driver Missense Mutation Identification Using Feature Selection and Model Fusion,” Journal of Computational Biology, Vol. 22, No. 13, pp. 1075-1085, Dec. 2015.

Driver mutations propel oncogenesis and occur much less frequently than passenger mutations. The need for automatic and accurate identification of driver mutations has increased dramatically with the exponential growth of mutation data. Current computational solutions to identify driver mutations rely on sequence homology. Here we construct a machine learning–based framework that does not rely on sequence homology or domain knowledge to predict driver missense mutations.

7b. More precise radiotherapy treatment of lung tumors

lung-cancer-treatmentS.S. Iyengar, Xin Li, Huanhuan Xu, Supratik Mukhopadyay, N. Balakrishana, Amit Sawant and Puneeth Iyengar worked towards providing a better more precise radiotherapy treatment of lung tumor computer in January 2012. Dr. Iyengar began examining the problem of detecting lung cancer through motion tracking, pattern recognition, and high-performance real-time processing. His 4D motion model can now perform 4D monitoring of the entire irradiated anatomical volume, significantly increasing a physician’s confidence in prescribing more aggressive radiation treatments. This is possible since the invention measures more precisely the dosages administered to the patient, thereby assuring the surgeon that dosages are exactly placed to determine treatment efficacy, since dosage accuracy is assured. While this treatment is still limited in use, indications are this treatment will significantly increase the lifespans’ for cancer survivors. A computational framework for modeling the respiratory motion of lung tumors provides a 4D parametric representation that tracks, analyzes, and models movement to provide more accurate guidance in the planning and delivery of lung tumor radiotherapy.

7c. Early Glaucoma Detection

Dr. Iyengar and his former colleagues at Nulogix invented a device with an innovative technology that enables a person to monitor and see changes in intra-ocular pressure (IOP) simply by looking at his eye in the mirror. The purpose of this invention is to ensure that glaucoma’s silent damage is detected as early as possible before pressures rise to a level where damage to the eye can occur. It will be especially useful to people diagnosed early and who are at high risk of getting their retina damaged by increased intra-ocular pressure, such as those with high blood pressure or a genetic history of glaucoma. The device was also developed for those living in rural areas where medical care and the currently large, expensive diagnostic equipment is not available for monitoring daily or weekly changes in the eye’s pressure.

The U.S. Patent Office and the World Intellectual Property Organization have published patent applications filed by Dr. Iyengar and Nulogix for this invention. The company was recently named a finalist in the Enterprise Charlotte Economic Council’s “Innovation 2 Industry Florida” competition for this technology and is seeking investment and clinical partners.

logo_center_38. NSF I/UCRC Center for Knowledge Enablement

Dr. Iyengar is a Co-Principle Investigator of the NSF Industry-University Cooperative Research Center (I/UCRC) Program, Center for Advanced Knowledge Enablement (CAKE) at FIU.

IUCRC enables industrially-relevant, pre-competitive research via a multi-member, sustained partnerships between industry, academe, and government. NSF supports the development and evolution of IUCRCs, providing a financial and procedural framework for membership and operations in addition to best practices learned over decades of fostering public/private partnerships that provide significant value to the nation, industry and university faculty and students.

The CAKE Center studies the representation, management, storage, analysis, search and social aspects of large and complex data. The research is applicable to biomedical, defense, disaster mitigation, homeland security, environmental concerns, real estate, health records management, finance, and technology service companies. The faculty carry out research in performance studies, benchmark evaluations, and the application of novel algorithms, routines, data models, network analyses and software tools to large-scale data sets. The research being carried out in the universities in this area and more broadly in information technology underpins advances in virtually every other area of science and technology and provides new capacity for economic productivity.

Every two years NSF publishes a Compendium of Technology Breakthroughs of NSF I/URC Centers, a book to advise U.S. Congress and Public on the state of science and technology.

The 2014 NSF Compendium featured on its cover work of the FIU NSF Center: TerraFly and Balloon aerial platform co-sponsored by NSF and Altametry Inc: http://cake.fiu.edu/Compendium-2014/

The 2016 NSF Compendium just published showcases six articles about breakthroughs of our Center, more than any other NSF I/UCRC center in any discipline in the country. The 2016 cover features work led by Dr. Sakhrat Khizroev “Wireless Deep-Brain Stimulation With Magnetoelectric Nanoparticles” at the FIU NSF I/UCRC Center. This work is co-sponsored by NSF and the Neuroscience Centers of Florida Foundation: http://cake.fiu.edu/Compendium-2016/

nsf-books2