I’ve been a data (reporting) analyst for nearly a decade. I got my start writing complex SQL queries to develop reports and expanded into visualization (Tableau, Power BI). Lately I spent time as a data modeler designing DBs and helping create ETLs using ADF (though not putting hands on that process myself, I’m familiar enough with it to make it work).

I’m looking for my next opportunity and finding that my lack of knowledge in Python is creating a blocker. Also, other skills I don’t have seem to crop up, like Spark, Hadoop, etc. It seems like the Data Engineer role has been folded into my Data Analyst role and I just can’t compete any more.

Would anyone have any suggestions for paths I might take to remedy this? I can work with some online Python courses but I feel I’m not getting the full experience needed to really support the new needs being asked of those in my role. I’m hoping someone might have some suggestions for directions I might take to up-skill myself and be more prepared for the emerging needs of this changing industry.

  • Mamertine@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Start applying.

    If you want to learn Python, edX has a good course on it.

    I’m a data engineer. I write Python once or twice a year. I’m terrible at it.

    My shop has no spark or Hadoop anymore.

    We want applicants who can write SQL really well and have experience modeling data. You can learn the tools easily if you have experience with similar tools

    • starlordOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Well hey, if you’re looking for experience with SQL and data modeling, I’m available.

      I’ll look into edX, thanks for the suggestion!

      • Mamertine@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        A thought, we were hiring a data engineer. We saw a lot of resumes that had data engineer titles, but highlighted reporting skills not data engineering skills. If you’re applying for a role, be sure your resume reflects that you have skills and accomplishments for the role you are applying for.