March « 2012 « Doing It Wrong

Doing It Wrong archive

Date : March 2012 (1)

Achievement Tracking

by James Martini

Categories: Journal

Tags: No Tags

Comments: Comments Off

Published on: March 26, 2012

Achievements in progress
========================
Stay away for 7 days – 1 day
Starter diet – 1 day
Starting strong – 1 day
Grasshopper –

page 1 of 1

Recent Posts

Cheating Irises by James Martini

HAL8999 7/100 I was sick yesterday but did spend some time looking over some “cheat sheets” that people had put together for various machine learning topics. Some were good, some were just stupid (I’m looking at you Machine Learning in Emoji). Also went through a very simply classifier based on the iris data set.

from sklearn import neighbors, datasets, preprocessing
from sklearn.model_selection import train_test_split
from sklearn.metrics import accuracy_score

# load the data into training and test sets
iris = datasets.load_iris()
X, y = iris.data[:, :2], iris.target
X_train, X_test, y_train, y_test = train_test_split(X, y, random_state=13)

# scale the data
scaler = preprocessing.StandardScaler()
scaler.fit(X_train)
X_train = scaler.transform(X_train)
X_test = scaler.transform(X_test)

# train a k-nearest neighbors model
knn = neighbors.KNeighborsClassifier(n_neighbors = 5)
knn.fit(X_train, y_train)

# Test the model
y_pred = knn.predict(X_test)
print(accuracy_score(y_test, y_pred))

from sklearn import neighbors, datasets, preprocessing

from sklearn.model_selection import train_test_split

from sklearn.metrics import accuracy_score

# load the data into training and test sets

iris = datasets.load_iris()

X, y = iris.data[:, :2], iris.target

X_train, X_test, y_train, y_test = train_test_split(X, y, random_state=13)

# scale the data

scaler = preprocessing.StandardScaler()

scaler.fit(X_train)

X_train = scaler.transform(X_train)

X_test = scaler.transform(X_test)

# train a k-nearest neighbors model

knn = neighbors.KNeighborsClassifier(n_neighbors = 5)

knn.fit(X_train, y_train)

# Test the model

y_pred = knn.predict(X_test)

print(accuracy_score(y_test, y_pred))

[…]

Transformers, more than mee… by James Martini
HAL8999 6/100 Watched the “Learn how to Learn” Google talk on youtube Updated the jupyter notebooks for handson-ml from github and read through the Ch2 notebook to address the CategoricalEncoder issue from yesterday Looked at a basic transformer Part of building a data pipeline is likely to include the creation of custom transformer classes to[…]
from handson-ml import BrokeAsFuck by James Martini
HAL8999 – 5/100 Today while going back through the Hands On Machine Learning book Ch2 I learned that the CategoricalEncoder referenced in the section on handling categorical attributes still isn’t in scikit-learn. I checked the reqirements.txt which shows scikit-learn=0.19.1. Checking my virtualenv, I should be good.

$ grep scikit-learn handson-ml/requirements.txt scikit-learn==0.19.1 $ pip freeze |grep scikit-learn scikit-learn==0.19.2

1
2
3
4

$ grep scikit-learn handson-ml/requirements.txt
scikit-learn==0.19.1
$ pip freeze |grep scikit-learn
scikit-learn==0.19.2

Turns out that the CategoricalEncoder isn’t going to[…]
Long days, no blog post by James Martini
HAL8999 – [3,4]/100 Chapter 2 of Hands on ML continues Creation of test sets Stratified sampling sklearn’s StratifiedShuffleSplit Visualizing data with matplotlib Coorelation coefficients Getting a good train-test split Since you can’t train a model and just expect it to work well right out of the box it’s standard practice to split off about 20%[…]