PaaS Continuous Delivery

PaaS Continuous Delivery

Google App Engine and Cloud Build Continuous Delivery

SOURCE CODE HERE: https://github.com/noahgift/delivery

SCREENCAST of Tutorial Here:

1. Create a Github repo
2. Create a project in GCP UI (your project name will be different) 2A Setup API as well

1. Activate cloud-shell and add ssh-keys if not already added to Github: i.e. ssh-keygen -t rsa than upload key to Github ssh settings.

2. Create initial project scaffold. You will need the following files which you can create with the following commands. Note you can copy app.yaml, main.py, main_test.py and requirements.txt from this repo from google.

• Makefile: touch Makefile

This allows an easy to remember convention.

• requirements.txt: touch requirements.txt

These are the packages we use.

• app.py: touch app.yaml

This is part of the IaC (Infrastructure as Code) and configures the PaaS environment for Google App Engine.

• main.py: touch main.py

This the logic of the Flask application.

1. Run describe

verify project is working

gcloud projects describe $GOOGLE_CLOUD_PROJECT

output of command:

createTime: '2019-05-29T21:21:10.187Z'
lifecycleState: ACTIVE
name: helloml
projectId: helloml-xxxxx
projectNumber: '881692383648'

1. You may want to verify you have the correct project and if not, do this to switch:

gcloud config set project $GOOGLE_CLOUD_PROJECT

1. Create app engine app:

gcloud app create 

this will ask for the region. Go ahead and pick us-central [12]

Creating App Engine application in project [helloml-xxx] and region [us-central]....done.
Success! The app is now created. Please use `gcloud app deploy` to deploy your first app.

1. create and source the virtual environment:

virtualenv --python $(which python) venv
source venv/bin/activate

double check it works:

which python
/home/noah_gift/python-docs-samples/appengine/standard_python37/hello_world/venv/bin/python

1. activate cloud shell editor

1. install packages:

make install

this should install flask and other packages you have created

Flask==1.x.x

1. run flask locally

this runs flask locally in gcp shell

python main.py

1. preview

1. update main.py

from flask import Flask
from flask import jsonify

app = Flask(__name__)

@app.route('/')
def hello():
    """Return a friendly HTTP greeting."""
    return 'Hello I like to make AI Apps'

@app.route('/name/<value>')
def name(value):
    val = {"value": value}
    return jsonify(val)

if __name__ == '__main__':
    app.run(host='127.0.0.1', port=8080, debug=True)

1. Test out passing in parameters to exercise this function:

@app.route('/name/<value>')
def name(value):
    val = {"value": value}
    return jsonify(val)

For example, calling this route will take the word lion and pass into the name function in flask:

https://8080-dot-3104625-dot-devshell.appspot.com/name/lion

returns value in web browser:

{
value: "lion"
}

1. Now deploy the app

gcloud app deploy

Warning first deploy could take about 10 minutes FYI!!! you may also need to enable cloud build API.

Do you want to continue (Y/n)?  y
Beginning deployment of service [default]...
╔════════════════════════════════════════════════════════════╗
╠═ Uploading 934 files to Google Cloud Storage              ═╣

1. Now stream the log files:

gcloud app logs tail -s default

1. The production app is deployed and should like this:

Setting traffic split for service [default]...done.
Deployed service [default] to [https://helloml-xxx.appspot.com]
You can stream logs from the command line by running:
  $ gcloud app logs tail -s default

  $ gcloud app browse
(venv) noah_gift@cloudshell:~/python-docs-samples/appengine/standard_python37/hello_world (helloml-242121)$ gcloud app
 logs tail -s default
Waiting for new log entries...
2019-05-29 22:45:02 default[20190529t150420]  [2019-05-29 22:45:02 +0000] [8] [INFO] Starting gunicorn 19.9.0
2019-05-29 22:45:02 default[20190529t150420]  [2019-05-29 22:45:02 +0000] [8] [INFO] Listening at: http://0.0.0.0:8081
 (8)
2019-05-29 22:45:02 default[20190529t150420]  [2019-05-29 22:45:02 +0000] [8] [INFO] Using worker: threads
2019-05-29 22:45:02 default[20190529t150420]  [2019-05-29 22:45:02 +0000] [25] [INFO] Booting worker with pid: 25
2019-05-29 22:45:02 default[20190529t150420]  [2019-05-29 22:45:02 +0000] [27] [INFO] Booting worker with pid: 27
2019-05-29 22:45:04 default[20190529t150420]  "GET /favicon.ico HTTP/1.1" 404
2019-05-29 22:46:25 default[20190529t150420]  "GET /name/usf HTTP/1.1" 200

1. Add a new route and test it out

@app.route('/html')
def html():
    """Returns some custom HTML"""
    return """
    <title>This is a Hello World World Page</title>
    <p>Hello</p>
    <p><b>World</b></p>
    """

1. Install pandas and return json results

At this point, you may want to consider creating a Makefile and do this:

touch Makefile
#this goes inside that file
install:
	pip install -r requirements.txt

you also may want to setup lint:

pylint --disable=R,C main.py
------------------------------------
Your code has been rated at 10.00/10

Route looks like this:

add pandas import at top:

import pandas as pd

@app.route('/pandas')
def pandas_sugar():
    df = pd.read_csv("https://raw.githubusercontent.com/noahgift/sugar/master/data/education_sugar_cdc_2003.csv")
    return jsonify(df.to_dict())

When you call the route https://<yourapp>.appspot.com/pandas

you should get something like this:

Cloud Build Continuous Deploy

Now to setup Cloud Build Continuous Deploy you can follow guide here.

• Create a cloudbuild.yaml file
• Add to the repo and push git add cloudbuild.yaml, git commit -m "add cloudbuild config", git push origin master.
• Create a build trigger
• Push a simple change
• View progress in build triggers page

References

• Enable Trigger on Github
• GAE Quickstart
• Cloud Build Continuous Deploy
• Cloud Build GCP Hello ML