Laptop —>> HADOOP Hdfs →> DataNodes

What is Hadoop?

Hadoop is open source and is Java based

Reliable ( makes many copies) and Scalable as it keeps multiple copies and can be scaled as we can add more hardware to scale it

Multiple Applications can run at same time

MapReduce is…

T test, Z score, Gini Index, Expected Value, Bayes Theorem, Central Limit Theorem, Anova , Distribution Types

Measures of Central Tendency -

Sum of observations / Number of observations

2 Median = Middle

{1,4,2,6,8} ={1,2,4,6,8}

4 is median

if values are even what is median?

Median = Mean of 4,8 = 12/2 =6

sum / number of observations


Outcome = Result of an experiment

Probability = Chance that that event will occur

Probability Scale is between 0 to 1

1 = event will happen

0.5 = equally likely event will happen

Theoretical Probability = what we expect to happen ,

P (E) =…

Multi Class Classification is not just Positive or Negative emotions it can have a range of outcomes [1,2,3,4,5,6…n]

Filtering comments for obscene and bad language before posting

Online Bullying

Understanding Sentiments

Identifying angry customers and offering timely service

Many More


import numpy as np
import pandas as pd
import matplotlib.pyplot as plt
from keras.preprocessing.text import Tokenizer
from keras.preprocessing.sequence import pad_sequences
from keras.layers import Dense, Input, GlobalMaxPooling1D
from keras.layers import Conv1D, MaxPooling1D, Embedding
from keras.models import Model
from sklearn.metrics import roc_auc_score

Word2vec Dict : Using glove.6B/glove.6B

word2vec = {}
with open(os.path.join('glove.6B/glove.6B.%sd.txt' %…

Using Neural Networks — Keras

Python Implementation

Creating the layers

Fitting the model

Check the predictions for a specific user

Collaborative Filtering

1 Collaborative Filtering : ( Users and Items)

  • Memory Based ( Based on Historic Data , Filtering , Cosine Similarity , Correlation Matrix etc)
  • Model ( Predictive methods using a…



Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store