Customer Logins

Obtain the data you need to make the most informed decisions by accessing our extensive portfolio of information, analytics, and expertise. Sign in to the product or service center of your choice.

Customer Logins

My Logins

All Customer Logins
S&P Global Commodity Insights
  • S&P Global
  • S&P Dow Jones Indices
  • S&P Global Engineering Solutions
  • S&P Global Market Intelligence
  • S&P Global Mobility
  • S&P Global Commodity Insights
  • S&P Global Ratings
  • S&P Global Sustainable1
Close
Discover more about S&P Global’s offerings.
Investor Relations
  • Investor Relations Overview
  • Presentations
  • Investor Fact Book
  • News Releases
  • Quarterly Earnings
  • SEC Filings & Reports
  • Executive Committee
  • Merger Information
  • Governance
  • Stock & Dividends
  • Shareholder Services
  • Contact
English
  • Español
  • 中文网站
  • Português
  • 한국어
  • हिंदी
  • English (Australia)
  • 日本語
Support
  • Get Support
  • System Notifications
  • Delivery Platforms
  • Regulatory Engagement
Login
  • Commodity Insights Login
  • Access IHS Markit Products
Register
  • Commodities
  • Products & Services
  • Methodology
  • Market Insights
  • Energy Transition
  • Events
  • S&P Global
  • S&P Dow Jones Indices
  • S&P Global Engineering Solutions
  • S&P Global Market Intelligence
  • S&P Global Mobility
  • S&P Global Commodity Insights
  • S&P Global Ratings
  • S&P Global Sustainable1
  • Oil Upstream LNG Natural Gas Electric Power Coal Shipping Petrochemicals Metals Agriculture
    Latest in Commodities
    Listen: The future of naphtha and diesel flows after EU sanctions

    What will replace Russian diesel and naphtha flows to Europe after EU sanctions take effect on 5...

    UK's January road fuel sales recover to highest for month since 2020

    The UK's road fuel sales recovered from seasonal lows in January to hit their highest average for...

    China to cut clean oil product exports in Feb amid strong domestic demand

    China's refineries will cut clean oil product exports in February as domestic demand in January was...

  • Oil LNG Natural Gas Electric Power Coal Shipping Petrochemicals Metals Agriculture Energy Transition
    I Need
    Market Insights and Analytics Commodity Prices and Essential Market Data Real-Time News, Prices and Analysis Maps and Geospatial Data Forward Curves and Risk Valuation Data
    Data and Partner Delivery
  • Our Methodology Methodology & Specifications Price Assessments Subscriber Notes Price Symbols Symbol Search & Directories Corrections Complaints
    References
    Market On Close Index Sourced Data (Survey) Methodology Review & Change MOC Participation Guidelines Holiday SEE ALL REFERENCE TOOLS
  • Latest News Headlines All Topics Videos Podcasts Special Reports Infographics Insights Magazine Insight Blog    Research & Analysis Top 250 Rankings   
    Latest in Market Insights
  • PLATTS ANALYTICS PRODUCT PLATFORM
    ACCESS ANALYTICS HUB
  • All Events Webinars Conferences Methodology Education Training and eLearning Forums Global Energy Awards    Global Metals Awards   
    Featured Events
    Forums London Energy Forum
    • 27 Feb 2023
    • London
    Forums CERAWeek
    • 27 Feb 2023
    • London
    Conferences ,Forums FUJCON 2023
    • 13 Mar 2023
    • Fujairah, UAE

From baby boomers to data scientists: establishing a new approach to data management in the energy industry

12 January 2017

The energy industry is facing a major challenge: members of the baby boomer generation, who have for so long been responsible for the data on which firms rely, are now retiring and suitable successors are proving hard to find. The situation has highlighted the need for more efficient, effective and sustainable ways of managing data within the industry, and the search is now on for solutions.

Much of the data that energy firms consume is collected and maintained internally by specialists who have worked in the sector all their lives. A lack of new entrants into the industry during the downturn of the 1980s means there are few people with the experience necessary to replace these specialists when they retire. As a result, detailed knowledge of important energy data is at risk of being lost.

Firms realize that in order to avoid losing their competitive edge, they must digitize all remaining manual data sets and make them available for analysis by the new generation of data scientists and digital whizz kids who are emerging. The current emphasis on achieving cost efficiencies has only increased the importance of being able to thoroughly analyse data sets and derive insights from them.

As firms prepare for the changes I have described and re-evaluate their approach to data management, one of the most significant challenges they come up against is a lack of data standardization, which makes it complicated, time-consuming and expensive to work with multiple data sets.

For example, in order to build a complete understanding of a well, a firm may wish to use data from three or four external providers, as well as their own internal records. However, the lack of standardization in the way the data is represented (e.g. the use of different naming conventions for the same attributes) makes it difficult to combine and analyse. The challenge is no less acute when taking multiple sources of data from a single provider.

Of course, these issues are not unique to the energy sector. Energy firms can learn a lot from other industries, such as financial services, where a drive to increase efficiency, eliminate operational risk and unlock new insights has already led to the adoption of automated data management systems. In these industries, data management technology is being used to aggregate, validate, enrich and normalise data from different sources, creating a single, consistent version of the truth that is available to users throughout the organization.

As they lay the foundations for a new approach to data management, one of the most important lessons for energy firms to bear in mind is the importance of working with technology that is data-agnostic. This will ensure they can easily combine disparate data sets regardless of where they come from and the formats used.

To see the greatest benefits, firms should work with technology that allows them to combine traditional energy data with data sets from other sectors. For example, users can gain valuable insights if the data management platform they use allows them to co-mingle energy production data with broader financial and economic data.

In many cases, the data sets that energy firms have built up over decades are proverbial gold mines. However, antiquated data management practices mean these organizations can only scrape the surface of their valuable repositories of data. By equipping themselves with technology that enables them to analyse their complete data sets, firms can unlock the full potential of this data and successfully manage the generational changes that are taking place in the industry.

Spiros Giannaros is global head of Markit EDM, a data management platform that acquires, validates and distributes data of different kinds. He has 20 years' experience of helping firms in different industries to optimize their approach to data management.

Posted on January 12, 2017



This article was published by S&P Global Commodity Insights and not by S&P Global Ratings, which is a separately managed division of S&P Global.

Previous Energy & Natural Resources Post All Energy & Natural Resources Next Energy & Natural Resources Post

Related Posts

  • FERC’s proposed interconnection reforms provide hope for growing renewable project backlog
  • African OPEC heavyweights still underproducing, but 2023 has started brighter
  • Gorgon 1 Project development : What effect does a Carbon Tax have on the project’s development economic viability?
  • A year like no other: How 2022 supercharged the energy transition in the global power sector
  • ExxonMobil continues portfolio transformation with its latest divestment in Iraq
  • The Cambo Field Development
  • Can CNOOC reap the rewards that beneficial fiscal terms offer?
  • India’s power sector prepares for another hot summer in 2023

Explore

RELATED INDUSTRIES & TOPICS
  • Energy & Natural Resources

Recommended for you

  • Energy Solutions
  • Consulting
  • Upstream Oil & Gas
Subscribe to the Blog

Receive monthly energy insights from our blog right in your inbox.

Subscribe

CERAWeek 2023

March 6 – 10 in Houston, TX
LEARN MORE
Subscribe to RSS Feed

Follow Us

Mar 23
SPGlobalEnergy@SPGlobalEnergy

RT @SPGCIPetchems: Our #SPWPC Panel on Energy Transition 'The Increasing Interaction between Chemicals, Refining and Agri' Is well underway…

Mar 23
Jan 25
SPGlobalEnergy@SPGlobalEnergy

RT @SPGSustainable1: In our most recent report, we outline nine trends we see rising in prominence in the #sustainability landscape during…

Jan 25
Dec 31
SPGlobalEnergy@SPGlobalEnergy

𝗛𝗮𝗽𝗽𝘆 𝗡𝗲𝘄 𝗬𝗲𝗮𝗿! 𝗧𝗿𝗮𝗻𝘀𝗶𝘁𝗶𝗼𝗻 - A new journey for a new year! This account will be retired tomorrow. To keep up to da… https://t.co/Qaj4sgwJHx

Dec 31
Dec 30
SPGlobalEnergy@SPGlobalEnergy

𝗜𝗺𝗽𝗼𝗿𝘁𝗮𝗻𝘁 𝗡𝗲𝘄𝘀! 𝗧𝗿𝗮𝗻𝘀𝗶𝘁𝗶𝗼𝗻 - This account will be retired in 2 days. To keep up to date with the latest… https://t.co/nB3tSHqnt5

Dec 30
{"items" : [ {"name":"share","enabled":true,"desc":"<strong>Share</strong>","mobdesc":"Share","options":[ {"name":"facebook","url":"https://www.facebook.com/sharer.php?u=http%3a%2f%2fwww.spglobal.com%2fcommodityinsights%2fen%2fci%2fresearch-analysis%2ffrom-baby-boomers-to-data-scientists-establishing-a-new-approach-to-data-management-in-the-energy-industry.html","enabled":true},{"name":"twitter","url":"https://twitter.com/intent/tweet?url=http%3a%2f%2fwww.spglobal.com%2fcommodityinsights%2fen%2fci%2fresearch-analysis%2ffrom-baby-boomers-to-data-scientists-establishing-a-new-approach-to-data-management-in-the-energy-industry.html&text=From+baby+boomers+to+data+scientists%3a+establishing+a+new+approach+to+data+management+in+the+energy+industry","enabled":true},{"name":"linkedin","url":"https://www.linkedin.com/sharing/share-offsite/?url=http%3a%2f%2fwww.spglobal.com%2fcommodityinsights%2fen%2fci%2fresearch-analysis%2ffrom-baby-boomers-to-data-scientists-establishing-a-new-approach-to-data-management-in-the-energy-industry.html","enabled":true},{"name":"email","url":"?subject=From baby boomers to data scientists: establishing a new approach to data management in the energy industry&body=http%3a%2f%2fwww.spglobal.com%2fcommodityinsights%2fen%2fci%2fresearch-analysis%2ffrom-baby-boomers-to-data-scientists-establishing-a-new-approach-to-data-management-in-the-energy-industry.html","enabled":true},{"name":"whatsapp","url":"https://api.whatsapp.com/send?text=From+baby+boomers+to+data+scientists%3a+establishing+a+new+approach+to+data+management+in+the+energy+industry http%3a%2f%2fwww.spglobal.com%2fcommodityinsights%2fen%2fci%2fresearch-analysis%2ffrom-baby-boomers-to-data-scientists-establishing-a-new-approach-to-data-management-in-the-energy-industry.html","enabled":true}]}, {"name":"rtt","enabled":true,"mobdesc":"Top"} ]}
Filter Sort
  • About S&P Global Commodity Insights
  • Media Center
  • Advertisers
  • Locations
  • Get Support
  • Contact Us
  • Careers
  • Corporate Responsibility
  • History
  • Investor Relations
  • Leadership
  • Glossary
  • © 2023 by S&P Global Inc. All rights reserved.
  • Terms of Use
  • Do Not Sell My Personal Information
  • Privacy Policy & Cookie Notice
  • Site Map