data-mapping-model/SETUP.md

Setup the evaluation and explainability testing environment

Here is the setup guide for evaluation and explainability testing environment. If you want to observe the full pipeline service code, please take a look at Borbann repository.

Prerequisites

You need the following tools to run the evaluation and explainability testing environment

• Python 3.12
• Google Cloud SDK
• Vertex AI SDK
• UV

Also, you need to modify the code in vertex.py to point to your project ID and model name. Create your own model in Vertex AI platform first, using the train-1.jsonl, train-2.jsonl, train-3.jsonl as training data and evluation.jsonl as evaluation data.

Setup

uv sync

Evaluation

gcloud auth application-default login
uv run evaluate.py

Explainability

gcloud auth application-default login
uv run explainability.py