BCO Portal Local Deployment: Difference between revisions

From BCOeditor Wiki
Jump to navigation Jump to search
No edit summary
 
(26 intermediate revisions by the same user not shown)
Line 1: Line 1:
== Configuration ==
In order to work with BCO API locally on a '''Mac OS''', please follow the following steps to set up:
In order to work with BCO API locally on a '''Mac OS''', please follow the following steps to set up:


'''<big>BCO_API:</big>'''
== '''BCO_API''' ==
# Clone the GitHub Repository  
# Clone the GitHub Repository  
## Open Terminal, enter the following commands:  
## Open Terminal, enter the following commands:  
Line 25: Line 26:
## Once see the messages as shown in the figure above, go to http://localhost:8000/api/admin/ on the local browser to see if BCO API is set up successfully
## Once see the messages as shown in the figure above, go to http://localhost:8000/api/admin/ on the local browser to see if BCO API is set up successfully


'''<big>UserDB</big>'''
== '''UserDB''' ==
# Clone the GitHub Repository  
# Clone the GitHub Repository  
## Open Terminal, enter the following commands:  
## Open Terminal, enter the following commands:  
Line 38: Line 39:
#Modify the Config file: <code>vim portalusers/settings.py</code>
#Modify the Config file: <code>vim portalusers/settings.py</code>
#Make migrations: <code>python3.9 manage.py migrate</code>
#Make migrations: <code>python3.9 manage.py migrate</code>
#Create a super user for the API: <code>python3.9 manage.py createsuperuser</code> (Note: this step can be skipped if superuser is already created or not superuser account is not necessary)
#Create a super user for the API: <code>python3.9 manage.py createsuperuser</code> (Note: this step can be skipped if a superuser is already created or not superuser account is not necessary)
#Run server: <code>python3.9 manage.py runserver 8181</code>
#Run server: <code>python3.9 manage.py runserver 8181</code>
##If ran successfully, you should observe as shown in the following figure:[[File:Screen Shot 2022-10-05 at 14.20.20.png|800px|thumb|center]]
##If ran successfully, you should observe as shown in the following figure:[[File:Screen Shot 2022-10-05 at 14.20.20.png|800px|thumb|center]]
##Once see the messages as shown in the figure above, go to http://localhost:8181/users/admin/ on the local browser to see if BCO API is set up successfully (Note: If it worked you should be able to login using the SuperUser credentials you created above)
##Once see the messages as shown in the figure above, go to http://localhost:8181/users/admin/ on the local browser to see if BCO API is set up successfully (Note: If it worked you should be able to login using the SuperUser credentials you created above)
== '''Portal Deployment Instructions''' ==
#Clone the repository
##git clone https://github.com/biocompute-objects/portal
##cd portal/
#Switch to the desired branch: e.g. <code>git switch 22.10</code>
#Install packages with either of the following commands:
##<code>npm install</code>
##<code>npm install --legacy-peer-deps</code>
#Edit /portal/src/App.js line 87 based on your need :
##For local, <code>sending = hostnames.local</code>
##For the test site, <code>sending = hostnames.test</code>
##For the production site, <code>sending = hostnames.production</code>
#Start running: <code>npm run start</code>
== '''Production Portal Deployment''' ==
The BCO API repository contains a top-level folder “admin_only” which contains service definitions for gunicorn and Django. Thus, we can first clone the repository, then perform a few administrative steps to start the API.
# Connect to 'go.vpn.gwu.edu/SMHS_BIOC' VPN first.
# Enter test/production server via: <code>ssh USERNAME@test.portal.biochemistry.gwu.edu</code> (for test server)/<code>ssh USERNAME@portal.biochemistry.gwu.edu</code> (for production server) (Note: /home and /etc are shared between the two servers)
# Backup and archive DB:
## <code>cd /var/www/bcoeditor/db_backups</code>
## <code>cp ../bco_api/bco_api/db.sqlite3 db.sqlite3.bak.api.[TODAY'S DATE] (e.g. cp ../bco_api/bco_api/db.sqlite3 db.sqlite3.bak.api.22.10.25)</code>
## <code>cp ../userdb/db.sqlite3 db.sqlite3.bak.udb.[TODAY'S DATE]</code>
## <code>cp ../bco_api/bco_api/server.conf server.conf.bak.[TODAY'S DATE]</code>
# Pull the repository
## <code>cd /var/www/bcoeditor/bco_api</code>
## <code>git clone https://github.com/biocompute-objects/bco_api</code> (if cloned already, step not needed)
# Enter the repository, create a virtual environment and install the required packages:
## First switch to the proper user account via <code> su - bco_api_user</code> (If you need to use this account, please contact the BCO team for the password)
## Switch to the desired branch: <code>git switch 22.11</code>
## <code>source env/bin/activate</code>
## <code>pip3.9 install -r requirements.txt</code>
# Check the Configuration files:
## Edit the server.conf file: <code>vim /var/www/bcoeditor/bco_api/bco_api/server.conf</code>
### Change the version number to match the version you are modifying
# Make sure the server can run and Make Migrations:
## <code>cd /var/www/bcoeditor/bco_api/bco_api</code>
## <code>python3.9 manage.py migrate</code>
## <code>python3.9 manage.py collectstatic</code>
## <code>python3.9 manage.py runserver 8000</code>
## Go to https://test.portal.biochemistry.gwu.edu/api/admin/ to check if the server runs properly
## Ctrl+C to exit the running server
# sudo Steps:
## nGinx (only if bco_api.conf was modified): <code>sudo cp /var/www/bcoeditor/bco_api/admin_only/bco_api.conf  /etc/nginx/conf.d/</code>
## Gunicorn (only if bco_api.conf was modified):
### Copy the system service files over:
#### <code>sudo cp /var/www/bcoeditor/bco_api/admin_only/bco_api.service /etc/systemd/system/bco_api.service</code>
#### <code>sudo cp /var/www/bcoeditor/bco_api/admin_only/bco_api.socket /etc/systemd/system/bco_api.socket</code>
### Enable files: <code>sudo systemctl enable bco_api</code>
### Start the service: <code>sudo systemctl start bco_api</code>
## Make sure the service is running: <code>sudo systemctl status bco_api</code>
# Access API via web browser:
## Restart the server: <code>sudo systemctl restart nginx</code>
## Deactivate virtual environment: <code>deactivate</code>
## Check the server by going to either site on the web browser: https://biocomputeobject.org/api/admin/ (login using the SuperUser credential just created) or https://biocomputeobject.org/api/docs/
== '''UserDB Production Portal Deployment''' ==
# Connect to 'go.vpn.gwu.edu/SMHS_BIOC' VPN first.
# Enter test/production server via <code>ssh USERNAME@test.portal.biochemistry.gwu.edu</code> (for test server)/<code>ssh USERNAME@portal.biochemistry.gwu.edu</code> (for production server) (Note: /home and /etc are shared between the two servers)
# Enter the repository: <code>cd /var/www/bcoeditor/userdb</code>
# Clone the repository: <code>git clone https://github.com/biocompute-objects/bco_api</code>
# Change directory: <code>cd /var/www/bcoeditor/userdb/bco_api</code>
# Go to the desired branch/tag: <code>git switch 22.11(this number should be whatever branch you want to go to)</code>
# Create a virtual environment: <code>source env/bin/activate</code>
# Install the required packages: <code>pip3.9 install -r requirements.txt</code>
# Modify the Configuration file: <code>vim /var/www/bcoeditor/userdb/portalusers/settings.py</code>
# Make sure the server runs properly: <code>cd /var/www/bcoeditor/userdb</code>
## Make migrations: <code>python3.9 manage.py migrate</code> followed by <code>python3.9 manage.py collectstatic</code>
## Create a super user for the API: <code>python3.9 manage.py createsuperuser</code>
## Run server: <code>python3.9 manage.py runserver 8080</code>
## Ctrl+C to exit the running server
# Deactivate the virtual environment
#sudo Steps:
## Gunicorn (only if userdb.service OR userdb.socket IS MODIFIED): <code>cd admin_onlu</code>
### Copy the system service files over:
#### <code>sudo cp /var/www/bcoeditor/userdb/admin_only/userdb.service /etc/systemd/system/</code>
#### <code>sudo cp /var/www/bcoeditor/userdb/admin_only/userdb.socket /etc/systemd/system/</code>
### Enable files: <code>sudo systemctl enable bco_api</code>
### Start the service: <code>sudo systemctl start bco_api</code>
## Make sure the service is running: <code>sudo systemctl status bco_api</code>
## Restart the server:<code>sudo systemctl restart nginx</code>
## Make sure API is accessible via web browser. (EX: https://portal.biochemistry.gwu.edu/users/admin/. Log in using the superuser credential created)
== '''Portal Deployment''' ==
# Pull the repository: <code>cd /var/www/bcoeditor/portal</code>
# Switch branch:<code>git switch --detach 22.01(any branch name) -f</code>
# <code>npm install</code> or <code>npm install --legacy-peer-deps</code>
# Edit /var/www/bcoeditor/portal/src/App.js based on need. For example, when working on the test portal, make sure <code>const sending = hostnames.test</code>, also update the versions under <code>const versions</code>
== '''Manual Account Creation'''==
# Clear the dbs (rdb.sh) and sign up for an account: <code>sudo journalctl -u bco_api | tail -n 30</code>
# Take token and email and enter as follows:<code>[HOSTNAME]/api/accounts/activate/[EMAIL with @ escaped(%40)]/[TempID]['email', 'temp_identifier', 'hostname', 'token']
{'email': 'hadley_king@gwu.edu', 'temp_identifier': 'a20b90c7eec1447a9829071d60394951', 'hostname': 'https://portal.biochemistry.gwu.edu/users/add_api/', 'token': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ1c2VyX2lkIjoxLCJ1c2VybmFtZSI6ImhhZGxleWtpbmci</code>

Latest revision as of 15:10, 1 November 2022

Configuration

In order to work with BCO API locally on a Mac OS, please follow the following steps to set up:

BCO_API

  1. Clone the GitHub Repository
    1. Open Terminal, enter the following commands:
      1. git clone https://github.com/biocompute-objects/bco_api
      2. cd bco_api
  2. Switch to the latest release branch:
    1. git switch 22.10
  3. Enter the repository, create a virtual environment, and install the required packages:
    1. pyenv local 3.9.4 (Note: will show as pyenv: command not found if already installed)
    2. python3.9 -m venv env
    3. source env/bin/activate (activated virtual environment by showing (env) (base) MacBook-Pro-3:bco_api)
    4. python -m pip install -r requirements.txt (if installation failed, make sure you are in the correct path: /Users/Username/bco_api)
  4. Modify Configuration file
    1. Once in the virtual environment, make sure you are on the path:/Users/Username/bco_api
    2. Edit the server.conf file: vim bco_api/bco_api/server.conf
  5. Quick check to make sure the server can run
    1. cd bco_api/bco_api (Note after this command, should under path /Users/Username/bco_api/bco_api)
    2. Make migrations: python3.9 manage.py migrate
    3. If run successfully, should observe the following:
      Screen Shot 2022-10-04 at 15.05.22.png
  6. Create a super user for the API: python3.9 manage.py createsuperuser
    1. Follow the prompts
  7. python3.9 manage.py runserver 8000:
    Screen Shot 2022-10-04 at 15.15.54.png
    1. Once see the messages as shown in the figure above, go to http://localhost:8000/api/admin/ on the local browser to see if BCO API is set up successfully

UserDB

  1. Clone the GitHub Repository
    1. Open Terminal, enter the following commands:
      1. git clone https://github.com/biocompute-objects/userdb
      2. cd userdb/
  2. Switch to the desired branch: e.g. git switch 22.10
  3. Enter the repository, create a virtual environment, and install the required packages:
    1. pyenv local 3.9.4
    2. python3.9 -m venv env
    3. source env/bin/activate
    4. python -m pip install -r requirements.txt
  4. Modify the Config file: vim portalusers/settings.py
  5. Make migrations: python3.9 manage.py migrate
  6. Create a super user for the API: python3.9 manage.py createsuperuser (Note: this step can be skipped if a superuser is already created or not superuser account is not necessary)
  7. Run server: python3.9 manage.py runserver 8181
    1. If ran successfully, you should observe as shown in the following figure:
      Screen Shot 2022-10-05 at 14.20.20.png
    2. Once see the messages as shown in the figure above, go to http://localhost:8181/users/admin/ on the local browser to see if BCO API is set up successfully (Note: If it worked you should be able to login using the SuperUser credentials you created above)

Portal Deployment Instructions

  1. Clone the repository
    1. git clone https://github.com/biocompute-objects/portal
    2. cd portal/
  2. Switch to the desired branch: e.g. git switch 22.10
  3. Install packages with either of the following commands:
    1. npm install
    2. npm install --legacy-peer-deps
  4. Edit /portal/src/App.js line 87 based on your need :
    1. For local, sending = hostnames.local
    2. For the test site, sending = hostnames.test
    3. For the production site, sending = hostnames.production
  5. Start running: npm run start

Production Portal Deployment

The BCO API repository contains a top-level folder “admin_only” which contains service definitions for gunicorn and Django. Thus, we can first clone the repository, then perform a few administrative steps to start the API.

  1. Connect to 'go.vpn.gwu.edu/SMHS_BIOC' VPN first.
  2. Enter test/production server via: ssh USERNAME@test.portal.biochemistry.gwu.edu (for test server)/ssh USERNAME@portal.biochemistry.gwu.edu (for production server) (Note: /home and /etc are shared between the two servers)
  3. Backup and archive DB:
    1. cd /var/www/bcoeditor/db_backups
    2. cp ../bco_api/bco_api/db.sqlite3 db.sqlite3.bak.api.[TODAY'S DATE] (e.g. cp ../bco_api/bco_api/db.sqlite3 db.sqlite3.bak.api.22.10.25)
    3. cp ../userdb/db.sqlite3 db.sqlite3.bak.udb.[TODAY'S DATE]
    4. cp ../bco_api/bco_api/server.conf server.conf.bak.[TODAY'S DATE]
  4. Pull the repository
    1. cd /var/www/bcoeditor/bco_api
    2. git clone https://github.com/biocompute-objects/bco_api (if cloned already, step not needed)
  5. Enter the repository, create a virtual environment and install the required packages:
    1. First switch to the proper user account via su - bco_api_user (If you need to use this account, please contact the BCO team for the password)
    2. Switch to the desired branch: git switch 22.11
    3. source env/bin/activate
    4. pip3.9 install -r requirements.txt
  6. Check the Configuration files:
    1. Edit the server.conf file: vim /var/www/bcoeditor/bco_api/bco_api/server.conf
      1. Change the version number to match the version you are modifying
  7. Make sure the server can run and Make Migrations:
    1. cd /var/www/bcoeditor/bco_api/bco_api
    2. python3.9 manage.py migrate
    3. python3.9 manage.py collectstatic
    4. python3.9 manage.py runserver 8000
    5. Go to https://test.portal.biochemistry.gwu.edu/api/admin/ to check if the server runs properly
    6. Ctrl+C to exit the running server
  8. sudo Steps:
    1. nGinx (only if bco_api.conf was modified): sudo cp /var/www/bcoeditor/bco_api/admin_only/bco_api.conf /etc/nginx/conf.d/
    2. Gunicorn (only if bco_api.conf was modified):
      1. Copy the system service files over:
        1. sudo cp /var/www/bcoeditor/bco_api/admin_only/bco_api.service /etc/systemd/system/bco_api.service
        2. sudo cp /var/www/bcoeditor/bco_api/admin_only/bco_api.socket /etc/systemd/system/bco_api.socket
      2. Enable files: sudo systemctl enable bco_api
      3. Start the service: sudo systemctl start bco_api
    3. Make sure the service is running: sudo systemctl status bco_api
  9. Access API via web browser:
    1. Restart the server: sudo systemctl restart nginx
    2. Deactivate virtual environment: deactivate
    3. Check the server by going to either site on the web browser: https://biocomputeobject.org/api/admin/ (login using the SuperUser credential just created) or https://biocomputeobject.org/api/docs/

UserDB Production Portal Deployment

  1. Connect to 'go.vpn.gwu.edu/SMHS_BIOC' VPN first.
  2. Enter test/production server via ssh USERNAME@test.portal.biochemistry.gwu.edu (for test server)/ssh USERNAME@portal.biochemistry.gwu.edu (for production server) (Note: /home and /etc are shared between the two servers)
  3. Enter the repository: cd /var/www/bcoeditor/userdb
  4. Clone the repository: git clone https://github.com/biocompute-objects/bco_api
  5. Change directory: cd /var/www/bcoeditor/userdb/bco_api
  6. Go to the desired branch/tag: git switch 22.11(this number should be whatever branch you want to go to)
  7. Create a virtual environment: source env/bin/activate
  8. Install the required packages: pip3.9 install -r requirements.txt
  9. Modify the Configuration file: vim /var/www/bcoeditor/userdb/portalusers/settings.py
  10. Make sure the server runs properly: cd /var/www/bcoeditor/userdb
    1. Make migrations: python3.9 manage.py migrate followed by python3.9 manage.py collectstatic
    2. Create a super user for the API: python3.9 manage.py createsuperuser
    3. Run server: python3.9 manage.py runserver 8080
    4. Ctrl+C to exit the running server
  11. Deactivate the virtual environment
  12. sudo Steps:
    1. Gunicorn (only if userdb.service OR userdb.socket IS MODIFIED): cd admin_onlu
      1. Copy the system service files over:
        1. sudo cp /var/www/bcoeditor/userdb/admin_only/userdb.service /etc/systemd/system/
        2. sudo cp /var/www/bcoeditor/userdb/admin_only/userdb.socket /etc/systemd/system/
      2. Enable files: sudo systemctl enable bco_api
      3. Start the service: sudo systemctl start bco_api
    2. Make sure the service is running: sudo systemctl status bco_api
    3. Restart the server:sudo systemctl restart nginx
    4. Make sure API is accessible via web browser. (EX: https://portal.biochemistry.gwu.edu/users/admin/. Log in using the superuser credential created)

Portal Deployment

  1. Pull the repository: cd /var/www/bcoeditor/portal
  2. Switch branch:git switch --detach 22.01(any branch name) -f
  3. npm install or npm install --legacy-peer-deps
  4. Edit /var/www/bcoeditor/portal/src/App.js based on need. For example, when working on the test portal, make sure const sending = hostnames.test, also update the versions under const versions

Manual Account Creation

  1. Clear the dbs (rdb.sh) and sign up for an account: sudo journalctl -u bco_api | tail -n 30
  2. Take token and email and enter as follows:[HOSTNAME]/api/accounts/activate/[EMAIL with @ escaped(%40)]/[TempID]['email', 'temp_identifier', 'hostname', 'token']

{'email': 'hadley_king@gwu.edu', 'temp_identifier': 'a20b90c7eec1447a9829071d60394951', 'hostname': 'https://portal.biochemistry.gwu.edu/users/add_api/', 'token': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ1c2VyX2lkIjoxLCJ1c2VybmFtZSI6ImhhZGxleWtpbmci