Using the API

Now that you’ve deployed the model, you can test its API endpoints.

Procedure

  1. In the OpenShift AI dashboard, navigate to the project details page and click the Models tab.

  2. Click on the model information and take note of the Inference endpoint URL and the Token secret value.

    Model inference endpoint

  3. Return to the JupyterLab environment and try out your new endpoint.

    Follow the directions in 1_openai_requests.ipynb to try an OpenAI API call.

    Notebook OpenAI request
Next step

Delete the model