The results show that despite the deluge of Big Data, large majority still works in Gigabyte or Megabyte-size datasets. Data Scientists work with the largest-size datasets, followed by Data Engineers, Data Analysts, and Business Analysts. Read more for details.
Despite the deluge of big data, the results of 2020 Poll on largest dataset analyzed show that most respondents still work in gigabyte range, with essentially the same curve as in previous polls which asked this question starting in 2012. The data also shows a small, but notable segment working with web-scale data of over 100 Petabytes.
Fig. 1: KDnuggets Poll: Largest Dataset Analyzed, 2020, 2018, 2016
2020 data is shown as a column, to stand apart from lines for previous years.
The results are based on 562 participants.
Note that the poll asks about the largest dataset analyzed, so a typical dataset analyzed is expected to be significantly smaller.
Highlights:
This poll also asked about employment type, and the breakdown was
We also asked a new question - what was your main “data role”, and the responses were
#2020 jul opinions #data analysis