Data Lake Consultant

  • Data Lake Consultant

    Posted by Rhiannon Williams on January 11, 2021 at 6:31 am

    Hello,

     

    We are in the initial steps of developing a data lake to gather, clean, and consolidate data from each of our different systems. Does anyone have experience with a consultant or consulting company that can help guide us in this process?

     

    Thanks in advance and we look forward to your response(s)!

    ——————————
    Rhiannon Williams
    Management Analyst & Project Coordinator
    GVEC
    Gonzales TX
    8302639219
    ——————————

    Rolando Vega replied 3 years, 10 months ago 5 Members · 6 Replies
  • 6 Replies
  • Hema Sundaram

    Member
    January 11, 2021 at 6:57 am

    My team has implemented Data Lake in AWS cloud and will be happy to jump into a call to share our learnings.

     

    ——————————————-
    Original Message:
    Sent: 1/11/2021 6:31:00 PM
    From: Rhiannon Williams
    Subject: Data Lake Consultant

    Hello,

     

    We are in the initial steps of developing a data lake to gather, clean, and consolidate data from each of our different systems. Does anyone have experience with a consultant or consulting company that can help guide us in this process?

     

    Thanks in advance and we look forward to your response(s)!

    ——————————
    Rhiannon Williams
    Management Analyst & Project Coordinator
    GVEC
    Gonzales TX
    8302639219
    ——————————

  • Kevin Praet (Adm)

    Member
    January 11, 2021 at 7:07 am

    Thanks @Ron and @Nolan very helpful! I will send this info to our utility member who may have some follow up questions (I’ll refer them back to this thread).

    Thanks again!​​

    ——————————
    Kevin Praet
    Membership Coordinator
    Utility Analytics Institute (UAI)
    Boulder CO
    315-440-3033
    ——————————
    ——————————————-
    Original Message:
    Sent: 01-08-2021 17:33
    From: Nolan Steiner
    Subject: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Hi Kevin:  give me a call and we can discuss further.   In short, at Avista we have built out “job families” with a progression within a “data science” job family as well as a “data science engineer” job family.   Each family has a progression (from beginner to expert) to allow for employee development as skills are enhanced & developed.     The Data Science Engineer is distinct from the traditional Data Engineer, in that it has a bent towards analytic and business facing awareness, not just data.    The Data Science job family is for the Data Scientist roles.  We have been recruiting from local universities for beginner data scientists as part of our strategy with community partnering.    I’ll ask our HR department if we can share our job families with each of the two listed above, as they contain the descriptions. responsibilities, skills for each.

     

      

     

    Aloha to all,

     

    Nolan Steiner

    Data Science – Business Interface

    ____________________

     

    Avista Corp.

    1411 E. Mission Avenue

    PO Box 3727   MSC-68

    Spokane, WA 99220-3727

    Work: 509-495-4479

    Cell: 509-279-5190

    Email: Nolan.Steiner@avistacorp.com

     

    CONFIDENTIALITY NOTICE: The contents of this email message and any attachments are intended solely for the addressee(s) and may contain confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or an agent of the intended recipient, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments.

    Original Message:
    Sent: 1/8/2021 5:23:00 PM
    From: Ron Capute
    Subject: RE: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Here is some general text I pulled from a recent opening at NextEra:

    We are looking for individuals with the qualities and skills listed below: 

    • The capacity of developing data models and algorithms best suited to a particular scenario
    • Assessing the effectiveness of the data model
    • Making use of different data-gathering techniques
    • Combine models through ensemble modeling
    • Use modeling to optimize the customer experience
    • Develop processes and tools to monitor model performance and accuracy 

     Qualifications and Technologies: 

    • Problem-solving skills
    • Knowledge of machine learning techniques
    • Knowledge of statistical techniques and concepts
    • Coding knowledge and experience with languages like C, C++, Python, R, Scala
    • Knowledge of database querying (SQL) and data frameworks
    • Experience with machine learning web services and libraries: Spark, H2O.ai, Tensorflow
    • Present information using data visualization techniques
    • Excellent communication skills to coordinate between different teams.
    • BSc/BA in Computer Science, Engineering or relevant field; graduate degree in Data Science or other quantitative field is preferred

    ——————————
    Ron Capute
    Agile Leader
    Florida Power & Light
    Jupiter FL
    5619043273
    ——————————

    Original Message:
    Sent: 01-08-2021 16:11
    From: Kevin Praet
    Subject: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Good Afternoon UAI Members,

    Happy Friday and I hope you’ve all had a great start to the new year! I’m currently working with a utility member who was interested in hearing from others on any roles, responsibilities, or job descriptions they might have for Data Scientists. Specifically if you have a template in place for this role, we’d be very interested in learning more.

    As always I appreciate your help and look forward to seeing your input.

    Thanks!

    ——————————
    Kevin Praet
    Membership Coordinator
    Utility Analytics Institute (UAI)
    Boulder CO
    315-440-3033
    ——————————

  • Eric Moreno

    Member
    January 12, 2021 at 5:57 am

    @Nolan

    Thanks for the information you shared and when it comes to recruiting from universities, do you recruit undergrad or graduate students?  How important is it that someone have a graduate degree to become a Data Scientist?  From what I’ve read, even within the field of data science itself, it appears that there are different flavors of data science.

    Thank you. ​

    ——————————
    Eric Moreno
    Sr. Business Analyst
    Southern California Gas Co.
    Los Angeles CA
    ——————————
    ——————————————-
    Original Message:
    Sent: 01-08-2021 17:33
    From: Nolan Steiner
    Subject: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Hi Kevin:  give me a call and we can discuss further.   In short, at Avista we have built out “job families” with a progression within a “data science” job family as well as a “data science engineer” job family.   Each family has a progression (from beginner to expert) to allow for employee development as skills are enhanced & developed.     The Data Science Engineer is distinct from the traditional Data Engineer, in that it has a bent towards analytic and business facing awareness, not just data.    The Data Science job family is for the Data Scientist roles.  We have been recruiting from local universities for beginner data scientists as part of our strategy with community partnering.    I’ll ask our HR department if we can share our job families with each of the two listed above, as they contain the descriptions. responsibilities, skills for each.

     

      

     

    Aloha to all,

     

    Nolan Steiner

    Data Science – Business Interface

    ____________________

     

    Avista Corp.

    1411 E. Mission Avenue

    PO Box 3727   MSC-68

    Spokane, WA 99220-3727

    Work: 509-495-4479

    Cell: 509-279-5190

    Email: Nolan.Steiner@avistacorp.com

     

    CONFIDENTIALITY NOTICE: The contents of this email message and any attachments are intended solely for the addressee(s) and may contain confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or an agent of the intended recipient, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments.

    Original Message:
    Sent: 1/8/2021 5:23:00 PM
    From: Ron Capute
    Subject: RE: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Here is some general text I pulled from a recent opening at NextEra:

    We are looking for individuals with the qualities and skills listed below: 

    • The capacity of developing data models and algorithms best suited to a particular scenario
    • Assessing the effectiveness of the data model
    • Making use of different data-gathering techniques
    • Combine models through ensemble modeling
    • Use modeling to optimize the customer experience
    • Develop processes and tools to monitor model performance and accuracy 

     Qualifications and Technologies: 

    • Problem-solving skills
    • Knowledge of machine learning techniques
    • Knowledge of statistical techniques and concepts
    • Coding knowledge and experience with languages like C, C++, Python, R, Scala
    • Knowledge of database querying (SQL) and data frameworks
    • Experience with machine learning web services and libraries: Spark, H2O.ai, Tensorflow
    • Present information using data visualization techniques
    • Excellent communication skills to coordinate between different teams.
    • BSc/BA in Computer Science, Engineering or relevant field; graduate degree in Data Science or other quantitative field is preferred

    ——————————
    Ron Capute
    Agile Leader
    Florida Power & Light
    Jupiter FL
    5619043273
    ——————————

    Original Message:
    Sent: 01-08-2021 16:11
    From: Kevin Praet
    Subject: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Good Afternoon UAI Members,

    Happy Friday and I hope you’ve all had a great start to the new year! I’m currently working with a utility member who was interested in hearing from others on any roles, responsibilities, or job descriptions they might have for Data Scientists. Specifically if you have a template in place for this role, we’d be very interested in learning more.

    As always I appreciate your help and look forward to seeing your input.

    Thanks!

    ——————————
    Kevin Praet
    Membership Coordinator
    Utility Analytics Institute (UAI)
    Boulder CO
    315-440-3033
    ——————————

  • Rolando Vega

    Member
    January 12, 2021 at 6:41 am

    Hello Nolan,

    I am the inquirer of the information. I am very interested in the job family definitions that Avista has come up with if it can be shared.

    Your help is greatly appreciated.

    Rolando

    Rolando E. Vega, Ph.D., P.E.

    Senior Manager, Advanced Analytics and Intelligence (A2I)

    Enterprise Advanced Analytics

    CPS Energy | 145 Navarro San Antonio, Texas 78205 | MD: 110903

    Office: 210.353.2538  | Mobile:  210.243.5807

    cpsenergy.com

    ——————————————-
    Original Message:
    Sent: 01-08-2021 17:33
    From: Nolan Steiner
    Subject: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Hi Kevin:  give me a call and we can discuss further.   In short, at Avista we have built out “job families” with a progression within a “data science” job family as well as a “data science engineer” job family.   Each family has a progression (from beginner to expert) to allow for employee development as skills are enhanced & developed.     The Data Science Engineer is distinct from the traditional Data Engineer, in that it has a bent towards analytic and business facing awareness, not just data.    The Data Science job family is for the Data Scientist roles.  We have been recruiting from local universities for beginner data scientists as part of our strategy with community partnering.    I’ll ask our HR department if we can share our job families with each of the two listed above, as they contain the descriptions. responsibilities, skills for each.

     

      

     

    Aloha to all,

     

    Nolan Steiner

    Data Science – Business Interface

    ____________________

     

    Avista Corp.

    1411 E. Mission Avenue

    PO Box 3727   MSC-68

    Spokane, WA 99220-3727

    Work: 509-495-4479

    Cell: 509-279-5190

    Email: Nolan.Steiner@avistacorp.com

     

    CONFIDENTIALITY NOTICE: The contents of this email message and any attachments are intended solely for the addressee(s) and may contain confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or an agent of the intended recipient, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments.

    Original Message:
    Sent: 1/8/2021 5:23:00 PM
    From: Ron Capute
    Subject: RE: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Here is some general text I pulled from a recent opening at NextEra:

    We are looking for individuals with the qualities and skills listed below: 

    • The capacity of developing data models and algorithms best suited to a particular scenario
    • Assessing the effectiveness of the data model
    • Making use of different data-gathering techniques
    • Combine models through ensemble modeling
    • Use modeling to optimize the customer experience
    • Develop processes and tools to monitor model performance and accuracy 

     Qualifications and Technologies: 

    • Problem-solving skills
    • Knowledge of machine learning techniques
    • Knowledge of statistical techniques and concepts
    • Coding knowledge and experience with languages like C, C++, Python, R, Scala
    • Knowledge of database querying (SQL) and data frameworks
    • Experience with machine learning web services and libraries: Spark, H2O.ai, Tensorflow
    • Present information using data visualization techniques
    • Excellent communication skills to coordinate between different teams.
    • BSc/BA in Computer Science, Engineering or relevant field; graduate degree in Data Science or other quantitative field is preferred

    ——————————
    Ron Capute
    Agile Leader
    Florida Power & Light
    Jupiter FL
    5619043273
    ——————————

    Original Message:
    Sent: 01-08-2021 16:11
    From: Kevin Praet
    Subject: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Good Afternoon UAI Members,

    Happy Friday and I hope you’ve all had a great start to the new year! I’m currently working with a utility member who was interested in hearing from others on any roles, responsibilities, or job descriptions they might have for Data Scientists. Specifically if you have a template in place for this role, we’d be very interested in learning more.

    As always I appreciate your help and look forward to seeing your input.

    Thanks!

    ——————————
    Kevin Praet
    Membership Coordinator
    Utility Analytics Institute (UAI)
    Boulder CO
    315-440-3033
    ——————————

  • Rolando Vega

    Member
    January 12, 2021 at 6:41 am

    Many thanks Ron! Your input is greatly appreciated.

    Rolando

    ——————————

    Rolando E. Vega, Ph.D., P.E.

    Senior Manager, Advanced Analytics and Intelligence (A2I)

    Enterprise Advanced Analytics

    CPS Energy | 145 Navarro San Antonio, Texas 78205 | MD: 110903

    Office: 210.353.2538  | Mobile:  210.243.5807

    cpsenergy.com

    ——————————
    ——————————————-
    Original Message:
    Sent: 01-08-2021 17:23
    From: Ron Capute
    Subject: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Here is some general text I pulled from a recent opening at NextEra:

    We are looking for individuals with the qualities and skills listed below: 

    • The capacity of developing data models and algorithms best suited to a particular scenario
    • Assessing the effectiveness of the data model
    • Making use of different data-gathering techniques
    • Combine models through ensemble modeling
    • Use modeling to optimize the customer experience
    • Develop processes and tools to monitor model performance and accuracy 

     Qualifications and Technologies: 

    • Problem-solving skills
    • Knowledge of machine learning techniques
    • Knowledge of statistical techniques and concepts
    • Coding knowledge and experience with languages like C, C++, Python, R, Scala
    • Knowledge of database querying (SQL) and data frameworks
    • Experience with machine learning web services and libraries: Spark, H2O.ai, Tensorflow
    • Present information using data visualization techniques
    • Excellent communication skills to coordinate between different teams.
    • BSc/BA in Computer Science, Engineering or relevant field; graduate degree in Data Science or other quantitative field is preferred

    ——————————
    Ron Capute
    Agile Leader
    Florida Power & Light
    Jupiter FL
    5619043273
    ——————————

    Original Message:
    Sent: 01-08-2021 16:11
    From: Kevin Praet
    Subject: Data Scientist: Roles, Responsibilities, Job Desciptions?

    Good Afternoon UAI Members,

    Happy Friday and I hope you’ve all had a great start to the new year! I’m currently working with a utility member who was interested in hearing from others on any roles, responsibilities, or job descriptions they might have for Data Scientists. Specifically if you have a template in place for this role, we’d be very interested in learning more.

    As always I appreciate your help and look forward to seeing your input.

    Thanks!

    ——————————
    Kevin Praet
    Membership Coordinator
    Utility Analytics Institute (UAI)
    Boulder CO
    315-440-3033
    ——————————

  • Hema Sundaram

    Member
    January 12, 2021 at 11:58 am

    We can share about our overall strategy, partners, architecture, and roadmap based on the needs. Thanks.

     

     

     

    Hema Sundaram

    Director, Data Strategy & Management • Cell 626-506-5684

    PortlandGeneral.com • Follow us on social @PortlandGeneral

    An Oregon kind of energy.

     

     

     

     

    ——————————————-
    Original Message:
    Sent: 1/11/2021 6:31:00 PM
    From: Rhiannon Williams
    Subject: Data Lake Consultant

    Hello,

     

    We are in the initial steps of developing a data lake to gather, clean, and consolidate data from each of our different systems. Does anyone have experience with a consultant or consulting company that can help guide us in this process?

     

    Thanks in advance and we look forward to your response(s)!

    ——————————
    Rhiannon Williams
    Management Analyst & Project Coordinator
    GVEC
    Gonzales TX
    8302639219
    ——————————

Log in to reply.