Data
- GCS samples: https://console.cloud.google.com/storage/browser/cloud-samples-data
scikit learn vs tensorflow vs keras vs pytorch
-
Scikit Learn: a general machine learning library (built on top of NumPy) (not a neural network)
-
PyTorch: deep learning framework (neural network)
- Suitable for:
- Flexibility
- Short training duration
- Debugging capabilities
-
Keras: higher-level deep learning framework (making code simpler and more concise than PyTorch and Tensorflow).
- High-level, run on top of Tensorflow. Interface rather than a standalone framework.
- Tensorflow supports Keras with tf.keras library
- Suitable for:
- Rapid prototyping
- Small dataset
- Multiple back-end support
-
Tensorflow: open-source software library for dataflow programming (especially with data in form of tensor)
- Compatible with wide range of hardware and devices
- Formats
- TensorFlow Lite
- TensorFlow.js
- TensorFlow Extended
- Suitable for:
- Large dataset
- High performance
- Functionality
- Object detection
-
Ways to adding labels to images
- From csv file with file path and label for each file
- From folder’s names
- Manually correct on the console itself
-
Images can be uploaded as a zip file.
- Additional images can be uploaded to “unlabeled” folder or with
-
Images can be exported to an csv file with labels, data types (training, test)
Neural network
- Input type
- Scalar, Vector, Matrix, Tensor (multi-dimensional matrix)
- NNLayers
- Input layer (layer 0)
- Hidden layers
- Output layer (e.g. output values)
- Neuron
- Input vector (X)
- Output (Y)
- f (W(transpose) * X) = Y
- Weight vector (W)
- Architectures
- Feed Forward NN
- Recurrent NN
- Convolution NN
- GAN: generative adversarial network
gcloud
1. Delete a model (in case the GUI bugs out)
gcloud ai models list
gcloud ai models delete $MODEL_ID