Skip to content

Add LLMMessage property to Experiment#4904

Open
ItsMrLin wants to merge 1 commit intofacebook:mainfrom
ItsMrLin:export-D93069107
Open

Add LLMMessage property to Experiment#4904
ItsMrLin wants to merge 1 commit intofacebook:mainfrom
ItsMrLin:export-D93069107

Conversation

@ItsMrLin
Copy link
Contributor

Summary:
Adds llm_messages property, setter, add_llm_messages(), and get_llm_messages_with_data() to Experiment to enable LLM integration in Ax quickly (e.g. LILO, LLAMBO). Messages are stored in _properties via a new Keys.LLM_MESSAGES constant.

This is a quick enablement — we can figure out a better, permanent storage place for LLM messages in the future.

Reviewed By: saitcakmak

Differential Revision: D93069107

@meta-cla meta-cla bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Feb 12, 2026
@meta-codesync
Copy link

meta-codesync bot commented Feb 12, 2026

@ItsMrLin has exported this pull request. If you are a Meta employee, you can view the originating Diff in D93069107.

@codecov-commenter
Copy link

codecov-commenter commented Feb 12, 2026

Codecov Report

❌ Patch coverage is 96.92308% with 4 lines in your changes missing coverage. Please review.
✅ Project coverage is 96.78%. Comparing base (44c7c38) to head (80c0260).

Files with missing lines Patch % Lines
ax/core/experiment.py 94.66% 4 Missing ⚠️
Additional details and impacted files
@@           Coverage Diff            @@
##             main    #4904    +/-   ##
========================================
  Coverage   96.78%   96.78%            
========================================
  Files         593      593            
  Lines       62303    62433   +130     
========================================
+ Hits        60297    60424   +127     
- Misses       2006     2009     +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

ItsMrLin added a commit to ItsMrLin/Ax that referenced this pull request Feb 12, 2026
Summary:

Adds `llm_messages` property, setter, `add_llm_messages()`, and `get_llm_messages_with_data()` to `Experiment` to enable LLM integration in Ax quickly (e.g. LILO, LLAMBO). Messages are stored in `_properties` via a new `Keys.LLM_MESSAGES` constant.

This is a quick enablement — we can figure out a better, permanent storage place for LLM messages in the future.

Reviewed By: saitcakmak

Differential Revision: D93069107
@ItsMrLin ItsMrLin force-pushed the export-D93069107 branch 2 times, most recently from 9cca4f8 to 80c0260 Compare February 13, 2026 20:23
ItsMrLin added a commit to ItsMrLin/Ax that referenced this pull request Feb 13, 2026
Summary:

Adds `llm_messages` property, setter, `add_llm_messages()`, and `get_llm_messages_with_data()` to `Experiment` to enable LLM integration in Ax quickly (e.g. LILO, LLAMBO). Messages are stored in `_properties` via a new `Keys.LLM_MESSAGES` constant.

This is a quick enablement — we can figure out a better, permanent storage place for LLM messages in the future.

Reviewed By: saitcakmak

Differential Revision: D93069107
Summary:

Adds `llm_messages` property, setter, `add_llm_messages()`, and `get_llm_messages_with_data()` to `Experiment` to enable LLM integration in Ax quickly (e.g. LILO, LLAMBO). Messages are stored in `_properties` via a new `Keys.LLM_MESSAGES` constant.

This is a quick enablement — we can figure out a better, permanent storage place for LLM messages in the future.

Reviewed By: saitcakmak

Differential Revision: D93069107
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants