Skip to content

Errors when running music_agent.py. #15

@ASasamori

Description

@ASasamori

I wanted to see all of tracing and evals metrics that JudgmentLabs can do (this is my first instance of running it other than the "Getting Started" information on the docs) but ran into a couple errors. I am unsure on whether or not these are supposed to be happening or not though.

I uncommented line 264, in main, which was to visualize the tracing. Here is the line:
music_recommendation_bot(handler) # uncomment to run without the test (if you just want tracing)

I got a TypeError of missing query:
TypeError: music_recommendation_bot() missing 1 required positional argument: 'query'

I put an empty string or "Taylor Swift" as an additional argument in the function call, as it matches the example. (I am not sure if this is correct or not.)

I then receive another error from the client.assert_test() call starting in line 279. Looking at the JudgeVal library, it doesn't seem assert_test() has tracer or function parameters, in it, so I am unsure on how lines 282 and 283 are supposed to operate. I changed the assert_test() function to assert_tracer_test(), but ran into further problems with that.

client.assert_test( scorers=[ToolOrderScorer()], examples=[example], tracer=handler, function=music_recommendation_bot, eval_run_name="langgraph_demo", project_name="langgraph_demo" )

Hope this clears some things up, as this is my first jump into the JudgeVal cookbook, and am getting myself familizared to create my own simple agent.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions