Soft Skills Will Make or Break You as a Data ScientistHamza BendemraBlockedUnblockFollowFollowingJan 11As businesses gather an increasing amount of data related to various aspects of their organisation (e.
internal business operations, customer purchases and behaviour), the demand for data-savvy employees has exploded over the last 5 years.
Business leaders have woken up to the fact that data-driven decision-making can lead to making better decisions (it is not the only factor of course, but that’s a discussion for another post).
As a result, there is a strong demand for data analysts and data scientists across a wide range of industries.
Since HBR’s declaration that Data Scientist is the “Sexiest Job of the 21st Century” back in 2012, a plethora of online and university courses have flourished to allow interested students to learn the fundamentals of Data Science.
Having transitions from an academic setting to working in industry, I believe several key aspects deserve more attention in the current discussion to ensure your long-term success as a Data Scientist.
In this post, I will focus on two:1.
There is no such thing as a “typical” Data Scientist experience.
Your journey and work experience as a Data Scientist will massively vary depending on the culture and data maturity level of the organisation you work at.
Photo by Jefferson Santos on UnsplashFor example, I was the first Data Science hire in my department.
This meant I spent the first few weeks mostly working as a Data Engineer setting up databases, and determining which data infrastructure would be most suitable for the organisation.
In the first months on the job, I didn’t type import sklearn once.
Rather, I spent weeks meeting with different stakeholders to discuss why and how to set up reliable data warehouses, and convincing decision-makers that the initial set-up costs (both in monetary terms and manpower hours) would pay off later down the line.
After this initial stage, I then mostly worked as a Data Analyst.
My days were spent writing Python scripts and SQL queries to organise and clean the various datasets collected (which were mostly in tabular form).
I set up automated data pipelines to automate data collection, cleaning, and processing.
I developed an analytics environment by standardising Python dependencies, implementing version control for all scripts produced, and writing core Python modules.
Only then, did I start analysing structured and unstructured data to identify trends and patterns using statistical and ML models.
I was able to go through the typical data science pipeline working on various supervised and unsupervised ML problems which were unearthed from formulating business questions in partnership with businesses leaders.
Finally, I was able to work as a Data Scientist and built various predictive, classification, and forecasting models.
Now, being able to get to this final stage took a lot of negotiation and convincing, primarily to buy me time to set things up before I could provide valuable action-oriented insights.
What I realised then is that all the hype surrounding AI is the best and worst thing that’s happened to it.
All the hype surrounding Machine/Deep Learning is the best and worst thing that’s happened to it.
It has increased interest (and funding) in the field but it has also created unreasonable expectations when applied in a business context.
It has reduced the work that we do as Expert Statisticians with Strong Programming Skills (isn’t that what a Data Scientist is?) to a string of buzzwords and headlines.
This has created an environment where businesses expect outcomes right away.
This is particularly the case if they don’t have an existing data infrastructure as they would often not know the preliminary groundwork that it takes, and I don’t blame them: you don’t know what you don’t know — that’s why you hire a data-savvy employee.
Which brings me to my second point.
Your soft skills will make or break you as a Data ScientistYour ability to communicate the value and insights that can be derived from your work is key to your long-term success as a Data Scientist.
You need to get C-level staff on board as you need data-driven leadership.
Your skills in presenting yourself and in articulating the value of your work will help you in hiring new employees and build your data-driven team.
Slowly, the results you are contributing to coupled with your ability to articulate the process and value of your work, will snowball and create interest in the rest of the organisation.
Take this opportunity to up-skill current employees who are interested in learning more, and create allies of your Data Science team in other departments of the organisation.
Photo by Campaign Creators on UnsplashWritten and oral communication skills such as the ability to prepare progress reports, presentations, and interactive data dashboards to communicate findings and insights to key stakeholders will increase the actual and perceived value you provide to the business.
You must be able to translate your findings into business decisions by also providing brief non-technical background on the techniques you used and the biases and uncertainties inherent to the data science process.
Building these soft skills alongside strong technical skills is no trivial feat and this is why skilled data scientists are so hard to find and so much sought-after.
But getting the skills to be a full-stack data scientist with strong communication skills is something that can be developed over time and should not be dismissed as optional.
This will be key to your long-term success in building a nurturing and fulfilling career in what some have called the “Sexiest Job of the 21st Century”.