Indian Science Technology and Engineering facilities Map
 
Preivious Next  

  Digital Catalogue for Technology and Products Development


   Technology and Product Development

    Basic Information

Technology developed: Customised automated Analytics Platform comprising a suite of tools shell scripts and data analysis (TP19765735029)
Category: Product(Hardware/Material/Software)
Details of Inventor(s):
Inventor Institution/Organization/Company Department Designation
Akhila P Indian Institute of Science Bengaluru SERC Consultant Specialist
Dr J Lakshmi Indian Institute of Science Bengaluru SERC Chief Research Scientist
Technical Application Area: Other
If 'Other', please specify:
HPC centre administration resource planning and analytics customised for CrayXC40 installations
Please give more details of new technical application area:
Customised, automated Analytics Platform comprising a suite of tools (shell scripts and data analysis scripts and models written in R or python and dashboards in html, css and javascript libraries), set to run automatically, cleaning up and processing extensive system log files for preparing data and providing valuable insights to: 1)Visualize and evaluate resource availability, utilization, parallel code performance, I-O statistics, node failures and accounting of HPC resources. 2)Provide data analytics for capacity planning and maintenance of HPC resources at SERC. 3)User, supervisor and administrator portal for batch job analytics and invoicing. 4)Secure, responsive, interactive dashboard displaying real time and post-facto analytics of HPC systems, batch jobs, performance metrics and estimated queue wait times rendered using opensource charting tools.
Organization(s):
Indian Institute of Science (IISc) Bengaluru
Affiliated Ministry: Select One...
Type of technology development: Indigenous
Does the technology help in replacing any import items currently
procured from outside India?
Yes
Does the technology have export potential? Yes
Category of Technology developed: Futuristic
Stage of Development: Field Test
Please describe in detail including the TRL Level:
Customized Product developed for specific HPC resource CrayXC40 and academic operational model in IISc Working product can be deployed in similar setups but some components will need redesign and coding for different resource and operational models TRL Level 7

    Abstract:

Applications: Real time resource utilization batch job statisticis and system component errors visualization. Real time queue wait time estimates and accounting for used resources by user research group Historic usage accounting and analytics by resource department user research group Monthly and annual accouting reports and invoices. Custom pricing model for HPC resources Tools for causal analytics job failure analytics system health and capacity resource planning.
Advantages: End to end analytics platform developed inhouse with custom capabilties for system adminstration accounting resource utilization and capacity planning for inhouse supercomputing resources and academic usage model at IISc Several modules of this platform can be customised into specific analytics products for CrayXC40 The overall architectural framework of the product can be used to scale up to distributed HPC resource management platform for generic HPC system administration.

    Technology Inputs:

Imported Equipment/Spare Parts:
Equipment/Spare Parts Year ITC-HS Code
NA
Indigenous Equipment/Spare Parts:
Equipment/Spare Parts Year ITC-HS Code
NA
Imported Raw Materials:
Raw Materials Year ITC-HS Code
NA
Indigenous Raw Materials:
Raw Materials Year ITC-HS Code
NA
Existing R&D Facilities used:
Facilities Year ITC-HS Code
NA

   Patents & Publications:

Patents:
Filed Patents (No.) Granted Patents (No.) Year
0 0 NA
Publications:
Submitted (No.) Published (No.) Year
0 0 NA

    Commercialization Potential:

Who are the Potential Licensees? Useful for all organisations hosting or support an HPC Center
What commercially available products address
the same problem?
Company Product Problem Addressed
Altair PBSPro Data Analytics for HPC and Cloud Details job usage statistics
Would you like to develop this invention further with
corporate research support?
Yes
Would you be interested in participating in cluster based
programs for commercialization research or business
planning for your invention?
No
      Submitted by: Prof KVS Hari Date of Submission: 26-11-2020



Chat Room      Write Review     Talk to Experts


THE VISION
THE MISSION
ABOUT I-STEM
It has always been the basic tenet of the Government of India, in generously funding R&D efforts at academic institutions over the years, that facilities established through such support be made available to those needing them and qualified to make use of them for their own research work
read more >>

However, this was never easy or straightforward for, among other reasons, there was no ready source of information of what facility was available and where. Thanks to the Web, it is much easier today to have a national and regional “inventory of resources”, so as to match users with the resources they need, and to do all this in an efficient and transparent manner.

This can lead to a leap in R&D productivity and greatly enhance the effectiveness of public investment. This is the motivation behind I-STEM.
read less <<
Visitor Hit Counter
Hosted at Indian Institute of Science
Copyright © 2024 I-STEM. All rights reserved.
Audited by: STQC Bengaluru.