记第一次 kaggle competition - Titanic
1. 数据集描述
Overview
The data has been split into two groups:
- training set (train.csv)
- test set (test.csv)
The training set should be used to build your machine learning models. For the training set, we provide the outcome (also known as the “ground truth”) for each passenger. Your model will be based on “features” like passengers’ gender and class. You can also use feature engineering to create new features.
The test set should be used to see how well your model performs on unseen data. For the test set, we do not provide the ground truth for each passenger. It is your job to predict these outcomes. For each passenger in the test set, use the model you trained to predict whether or not they survived the sinking of the Titanic.
Data Dictionary
| Variable | Definition | Key |
|---|---|---|
| survival | Survival 0 = No, 1 = Yes | |
| pclass | Ticket class | 1 = 1st, 2 = 2nd, 3 = 3rd |
| sex | Sex | |
| Age | Age in years | |
| sibsp | # of siblings / spouses aboard the Titanic | |
| parch | # of parents / children aboard the Titanic | |
| ticket | Ticket number | |
| fare | Passenger fare | |
| cabin | Cabin number | |
| embarked | Port of Embarkation | C = Cherbourg, Q = Queenstown, S = Southampton |
Variable Notes pclass: A proxy for socio-economic status (SES) 1st = Upper 2nd = Middle 3rd = Lower
age: Age is fractional if less than 1. If the age is estimated, is it in the form of xx.5 sibsp: The dataset defines family relations in this way… Sibling = brother, sister, stepbrother, stepsister Spouse = husband, wife (mistresses and fiancés were ignored) parch: The dataset defines family relations in this way… Parent = mother, father Child = daughter, son, stepdaughter, stepson Some children travelled only with a nanny, therefore parch=0 for them.
2. 第一次挑战
2.1 数据预处理
由于数据中存在很多非数值型数据和缺失值,需要进行预处理。数据处理常使用pandas库进行处理。
1 | # 传入dataframe,返回处理后的dataframe |
2.2 导入数据
1 | class TitanicDataset(Dataset): |
2.3 模型设计
第一次使用一个简单的线性模型,输入为7维,输出为1维,中间使用sigmoid函数进行激活。
1 | class TitanicModel(torch.nn.Module): |
为什么要使用squeeze()函数? 因为模型的输出是一个1维的张量,而标签是一个0维的张量,所以需要使用squeeze()函数将模型的输出转换为0维张量,才能与标签进行比较。PyTorch文档-squeeze()
2.4 模型训练
1 | train_dataset = TitanicDataset('./exec/titanic/train.csv') |
2.5 预测
1 | df = pd.read_csv('./exec/titanic/test.csv') |
最后,提交result.csv文件到kaggle平台,即可查看模型的准确率。 得到了0.66的“高”准确率。