Big Data

Big data is a term used to refer to data sets that are too large or complex for traditional data-processing application software to adequately deal with.

big-data bigdata

How to Scrape eBay Product Data Feed

Scrape eBay Product Data such as - item name, price, bid information, image, payment option etc and download eBay in CSV, Excel or JSON formats.

A Beginner’s Guide to Analyzing Data (Part 2)

This article is the second half of my two-part series for beginners on how to analyze data. The main goal of this guide is to teach and use some basic.

The World is Data Rich, But Information Poor!

It is very well said that “We are living in the Information Age”, not actually information, truly this is the Data Age, where there is the explosive growth of data.

Discover a New Approach to Data Intelligence

Learn how your organization can increase fraud detection while continuing to deliver consistent omnichannel customer experiences.

Global Terrorism Study : Exploratory and Descriptive Data Analysis

Global Terrorism Database Analysis was a quick project for understanding and implementing various descriptive statistics and exploratory data analysis techniques.

Deep dive into Apache Spark Window Functions

Window functions operate on groups of data and return values for each record or group.Deep dive into Apache Spark Window Functions

Apache Spark — Fast and Furious.

Apache Spark is a data processing framework that can quickly perform processing tasks on very large data sets, and can also distribute…

Netflix Recommender System — A Big Data Case Study

The story behind Netflix’s famous Recommendation System.Netflix Recommender System — A Big Data Case Study

Why you may be getting low test accuracy: try Kolmogorov-Smirnov

Kolmogorov-Smirnov helps to compare the distributions of the training and test set. Use Mahalanobis first for word embeddings.

What is Big Data?The world generates 2.5 Quintillion bytes of data per day

By processing on big data, we can predict the future as well as present behavior of result about specific thing.What is Big Data?

Dream of Becoming a Big Data Engineer?

We ain’t doing the same thing.Dream of Becoming a Big Data Engineer? Discover What Sets Us Apart From Software Engineers

From Business Requirements to Big Data Running Application

Big Data tools and technologies — Data Storage Frameworks.From Business Requirements to Big Data Running Application

GAVRO — Managed Big-Data Schema Evolution

Wouldn’t it be great to build a data ingestion architecture that was resilient to change? More specifically, resilient to schema evolution.

A Beginner’s Guide to Analyzing Data

We’ll learn crucial methods and functions from pandas and Matplotlib that help us clean, manipulate, and visualize our datasets.

Why Should you Always use Numpy

Numpy is better than the other methods because it uses C language in it’s background, C is a low-level language much more efficient and faster.

Strategies of Spark Join

We are all familiar with different kinds of joins: inner, outer, left, left-semi(yes it’s a type of join!) and so on. But ever wondered…

The Power of Pickletools : Handling Large Model Pickle Files

The data is increasing. More the data, more we can use it for solving different problems. Suppose you train a Machine Learning model for…

Data Warehousing: OLTP vs OLAP Queries

Data Warehousing: OLTP vs OLAP Queries - In the early days of business data processing, a write to the database typically corresponded to a commercial transaction taking place —…

Docker Commands

Simple Docker Commands To Get You Started. Docker is a set of platform as a service products that uses OS-level virtualization to deliver software in packages called containers.

10 Key Challenges Data Scientists Face In Machine Learning Projects

AI-driven, powered by AI, transforming with AI/ML, etc., are some taglines we have heard far too often from the products we are being sold…