DevOps - v2 to v3 migration docs
- toni
! PRE-RELEASE DEMO DOCUMENTATION !
GitLab Configurator Updates:
File: global/config.yaml
Paste the code below into the position indicated on the screen:
operations: gitlab.tunex.io:5050/marionette-develop/core/operations:latest
balances: gitlab.tunex.io:5050/marionette-develop/core/balances:latest
accounting: gitlab.tunex.io:5050/marionette-develop/core/accounting:latest
trading:
enabled: true
image: gitlab.tunex.io:5050/marionette-develop/core/trading:latest
separate_trading_user_account: false
default_market: "ETH-USDT"
Docker Compose Templates:
File: templates/compose/required.yaml.t
Paste the code below into the position indicated on the screen:
clickhouse:
image: clickhouse/clickhouse-server
volumes:
- ../data/clickhouse_data/:/var/lib/clickhouse/
- ../data/clickhouse_logs/:/var/log/clickhouse-server/
ulimits:
nproc: 65535
nofile:
soft: 262144
hard: 262144
File: templates/compose/backend.yaml.t
Paste the code below into the position indicated on the screen:
Replace the whole operations.
operations:
restart: always
image: {{components.operations}}
env_file:
- ../config/database.env
environment:
CANCEL_OVERAMOUNT: 1
{{#ifEquals components.trading.enabled true}}
SEPARATE_TRADING_USER_ACCOUNT: {{#ifEquals components.trading.separate_trading_user_account true}}1{{else}}0{{/ifEquals}}
{{/ifEquals}}
depends_on:
- clickhouse
{{#ifEquals mode "swarm"}}
deploy:
labels:
- "traefik.http.routers.operations.rule=Host(`{{base_url}}`) && PathPrefix(`/components/operations`)"
- "traefik.enable=true"
- "traefik.http.services.operations.loadbalancer.server.port=3000"
{{#if components.traefik.ssl}}
- "traefik.http.routers.operations.entrypoints=websecure"
- "traefik.http.routers.operations.tls=true"
- "traefik.http.routers.operations.tls.certresolver=myresolver"
- "traefik.http.routers.operations.middlewares=secureheaders"
{{else}}
- "traefik.http.routers.operations.entrypoints=web"
{{/if}}
{{/ifEquals}}
{{#ifEquals mode "compose"}}
labels:
- "traefik.http.routers.operations.rule=Host(`{{base_url}}`) && PathPrefix(`/components/operations`)"
- "traefik.enable=true"
- "traefik.http.services.operations.loadbalancer.server.port=3000"
{{#if components.traefik.ssl}}
- "traefik.http.routers.operations.entrypoints=websecure"
- "traefik.http.routers.operations.tls=true"
- "traefik.http.routers.operations.tls.certresolver=myresolver"
- "traefik.http.routers.operations.middlewares=secureheaders"
{{else}}
- "traefik.http.routers.operations.entrypoints=web"
{{/if}}
{{/ifEquals}}
File: templates/compose/backend.yaml.t
Paste the code below into the position indicated on the screen:
Replace the balances
File: templates/compose/backend.yaml.t
Paste the code below into the position indicated on the screen:
Replace the trading and add the accounting in the code bellow.
Server Migration:
This release introduces a new database, ClickHouse. To ensure a successful migration, follow the steps below for the initial setup.
Migration Process:
Step 1: Start the migration. Allow the accounting container to migrate with the db-bridge. Wait approximately 30 minutes before proceeding.
Run the following commands:
Bring down the current setup:
Start the required services:
Start the
db-bridgecontainer and monitor the logs:Start the
accountingcontainer:
If the migration fails:
Run this command to remove all ClickHouse data and retry:
Step 2: Verify the migration for the balances container. Ensure there are no errors in the logs.
Run the following commands:
Step 3: If everything is functioning correctly, start all containers:
Re-migration.
If you saw the error this is how you do migration manually.
Chcek puppeteer and remember balance of someone.
start accounting
open clickhouse client, then check if the tables exist
open logs for accounting in other terminal
In new windows run the marionette cli tool.
./m clirun the migration
make sure it is finished, check the logs
if no errors migration is done
restart balances
check puppeteer for balances and make sure the balances are same and there are not duplicate records