Graphlytic 5.1.2

Table of Contents

1. Description

Query the AI model defined in Graphlytic AI connections.

2. Connection

2.1. Parameters

Name	Description	Required	Default
MODEL	Model to use. String consisting of AI connection code, underscore, and model code. Example: graphlytic_cloud_ai_gpt-3.5-turbo-1106	yes	No

3. Query

Connects to the defined LLM model and executes the query prompt. Returns these parameters that can be used in subsequent job steps:

Parameter	Description
propmpt	The full prompt that was sent to the LLM.
role	The role in which the LLM responded.
response	The actual response from the LLM.

4. Script

Not used.

5. Examples

<!DOCTYPE etl SYSTEM "https://scriptella.org/dtd/etl.dtd">
 <etl>
    <description>Graphlytic job</description>
                
    <properties>
        job_name=Graphlytic job
    </properties>
            
    <!-- CONNECTIONS -->
    <!-- This connection assumes -->
    <!-- there is an AI Connection defined with code graphlytic_cloud_ai -->
    <!-- AND there is a model with code gpt-4-turbo-preview -->
    <connection id="graphAi" driver="llm">
        MODEL=graphlytic_cloud_ai_gpt-4-turbo-preview
    </connection>
            
    <connection id="logInfo" driver="log">
        level=INFO
    </connection>
                
    <!-- JOB STEPS -->
    <script connection-id="logInfo">
        STARTING JOB "$job_name"
    </script>
    
    <query connection-id="graphAi">
        What is the result of 1+2x0+5 ?
        <script connection-id="logInfo">
            [user]: $prompt
            [$role]: $response
        </script>
    </query>     
</etl>