fix(integrations): openai/openai-agents: convert input message format #5248

constantinius · 2025-12-17T12:52:08Z

Description

Convert messages to common gen_ai.request.messages structure

Issues

Closes https://linear.app/getsentry/issue/TET-1633/redact-images-openai-openai-agents
Closes https://linear.app/getsentry/issue/TET-1639/openai-output-not-rendered-nicely

…he schema we expect for the `gen_ai.request.messages`

linear · 2025-12-17T12:52:11Z

TET-1633 Redact images: OpenAI / OpenAI Agents

TET-1639 OpenAI: output not rendered nicely

…ntent and update message handling

sentry_sdk/integrations/openai.py

sentry_sdk/integrations/openai_agents/spans/invoke_agent.py

sentry_sdk/integrations/openai.py

…nAI message handling

sentry_sdk/integrations/openai.py

…rt-image-inputs

github-actions · 2026-01-13T12:59:46Z

Semver Impact of This PR

🟢 Patch (bug fixes)

📋 Changelog Preview

This is how your changes will appear in the changelog.
Entries from this PR are highlighted with a left border (blockquote style).

New Features ✨

feat(ai): add parse_data_uri function to parse a data URI by constantinius in #5311
feat(asyncio): Add on-demand way to enable AsyncioIntegration by sentrivana in #5288
feat(openai-agents): Inject propagation headers for HostedMCPTool by alexander-alderman-webb in #5297

Bug Fixes 🐛

fix(ai): redact message parts content of type blob by constantinius in #5243
fix(clickhouse): Guard against module shadowing by alexander-alderman-webb in #5250
fix(gql): Revert signature change of patched gql.Client.execute by alexander-alderman-webb in #5289
fix(grpc): Derive interception state from channel fields by alexander-alderman-webb in #5302

fix(integrations): openai/openai-agents: convert input message format by constantinius in #5248

fix(litellm): Guard against module shadowing by alexander-alderman-webb in #5249
fix(pure-eval): Guard against module shadowing by alexander-alderman-webb in #5252
fix(ray): Guard against module shadowing by alexander-alderman-webb in #5254
fix(threading): Handle channels shadowing by sentrivana in #5299
fix(typer): Guard against module shadowing by alexander-alderman-webb in #5253
fix: Stop suppressing exception chains in AI integrations by alexander-alderman-webb in #5309
fix: Send client reports for span recorder overflow by sentrivana in #5310

Documentation 📚

docs(metrics): Remove experimental notice by alexander-alderman-webb in #5304
docs: Update Python versions banner in README by sentrivana in #5287

Internal Changes 🔧

Release

ci(release): Bump Craft version to fix issues by BYK in #5305
ci(release): Switch from action-prepare-release to Craft by BYK in #5290

Other

chore(gen_ai): add auto-enablement for google genai by shellmayr in #5295
chore: Add type for metric units by sentrivana in #5312
ci: Update tox and handle generic classifiers by sentrivana in #5306

_{🤖 This preview updates automatically when you update the PR.}

sentry_sdk/integrations/openai.py

sentry_sdk/integrations/openai_agents/utils.py

sentry_sdk/integrations/openai.py

sentry_sdk/ai/utils.py

sentrivana

Looks ok to me, two things:

Can we add a check to the tests that we're not modifying the user's messages? Either as a new test or just adding an assert to the tests added in this PR
I assume there is no way to dedupe some of the trimming logic between OpenAI agents and OpenAI because the format is different?

…rt-image-inputs

sentry_sdk/integrations/openai_agents/utils.py

sentry_sdk/integrations/openai.py

constantinius · 2026-01-14T16:25:31Z

Can we add a check to the tests that we're not modifying the user's messages? Either as a new test or just adding an assert to the tests added in this PR

Done

I assume there is no way to dedupe some of the trimming logic between OpenAI agents and OpenAI because the format is different?

Looking into that. Cursor says no. But I'm not sure tbh

sentry_sdk/integrations/openai_agents/spans/invoke_agent.py

… of full message dicts - Extract choice.message.content for gen_ai.response.text instead of model_dump() - Add separate gen_ai.response.tool_calls extraction for Chat Completions API - Handle audio transcripts in responses - Extract shared extract_response_output() to ai/utils.py for Responses API output - Refactor OpenAI and OpenAI Agents integrations to use shared utility

constantinius · 2026-01-15T11:56:52Z

I assume there is no way to dedupe some of the trimming logic between OpenAI agents and OpenAI because the format is different?

I did investigate that. I did eliminate code duplication for output messages, but input messages are actually different

…AI messages Add transform_content_part() and transform_message_content() functions to standardize content part handling across all AI integrations. These functions transform various SDK-specific formats (OpenAI, Anthropic, Google, LangChain) into a unified format: - blob: base64-encoded binary data - uri: URL references (including file URIs) - file: file ID references Also adds get_modality_from_mime_type() helper to infer content modality (image/audio/video/document) from MIME types.

Replace local _convert_message_parts function with the shared transform_message_content function to deduplicate code across AI integrations.

cursor · 2026-01-15T13:13:52Z

sentry_sdk/integrations/openai_agents/spans/invoke_agent.py

+                            elif not isinstance(transformed, list):
+                                transformed = [
+                                    {"text": str(transformed), "type": "text"}
+                                ]


None content converts to literal string "None"

Medium Severity

When processing message objects in invoke_agent_span, if a message has no content key or content is None, the code converts it to the literal string "None". This happens because msg.get("content") returns None, _transform_openai_agents_message_content(None) returns None, and then str(None) produces "None". A message with missing content would incorrectly display as having content "None" rather than being handled as empty or skipped.

constantinius added 6 commits December 17, 2025 10:45

fix(ai): redact message parts content of type blob

1f32952

fix(ai): skip non dict messages

795bcea

fix(ai): typing

a623e13

fix(ai): content items may not be dicts

3d3ce5b

fix(integrations): OpenAI input messages are now being converted to t…

ce29e47

…he schema we expect for the `gen_ai.request.messages`

test(integrations): add test for message conversion

7074f0b

constantinius changed the title ~~test(integrations): add test for message conversion~~ fix(openai): convert input message format Dec 17, 2025

feat(integrations): add transformation functions for OpenAI Agents co…

e8a1adc

…ntent and update message handling

constantinius marked this pull request as ready for review January 8, 2026 08:34

constantinius requested a review from a team as a code owner January 8, 2026 08:34

constantinius changed the title ~~fix(openai): convert input message format~~ fix(integrations): openai/openai-agents: convert input message format Jan 8, 2026

cursor bot reviewed Jan 8, 2026

View reviewed changes

sentry_sdk/integrations/openai.py Outdated Show resolved Hide resolved

sentry_sdk/integrations/openai.py Outdated Show resolved Hide resolved

sentry_sdk/integrations/openai_agents/spans/invoke_agent.py Show resolved Hide resolved

sentry bot reviewed Jan 8, 2026

View reviewed changes

sentry_sdk/integrations/openai.py Outdated Show resolved Hide resolved

feat(ai): implement parse_data_uri function and integrate it into Ope…

c1a2239

…nAI message handling

cursor bot reviewed Jan 8, 2026

View reviewed changes

sentry_sdk/integrations/openai.py Outdated Show resolved Hide resolved

sentry_sdk/integrations/openai.py Outdated Show resolved Hide resolved

Base automatically changed from constantinius/fix/redact-message-parts-type-blob to master January 13, 2026 09:56

Merge branch 'master' into constantinius/fix/integrations/openai-repo…

bd46a6a

…rt-image-inputs

sentry bot reviewed Jan 13, 2026

View reviewed changes

sentry_sdk/integrations/openai.py Outdated Show resolved Hide resolved

fix: review comment

04b27f4

sentry bot reviewed Jan 13, 2026

View reviewed changes

sentry_sdk/integrations/openai_agents/utils.py Outdated Show resolved Hide resolved

cursor bot reviewed Jan 13, 2026

View reviewed changes

sentry_sdk/integrations/openai.py Outdated Show resolved Hide resolved

alexander-alderman-webb reviewed Jan 14, 2026

View reviewed changes

sentry_sdk/ai/utils.py Outdated Show resolved Hide resolved

sentrivana reviewed Jan 14, 2026

View reviewed changes

Merge branch 'master' into constantinius/fix/integrations/openai-repo…

f8345d0

…rt-image-inputs

cursor bot reviewed Jan 14, 2026

View reviewed changes

sentry_sdk/integrations/openai_agents/utils.py Show resolved Hide resolved

fix(integrations): addressing review comments

b74bdb9

sentry bot reviewed Jan 14, 2026

View reviewed changes

sentry_sdk/integrations/openai.py Outdated Show resolved Hide resolved

constantinius requested review from alexander-alderman-webb and sentrivana January 14, 2026 16:25

cursor bot reviewed Jan 14, 2026

View reviewed changes

sentry_sdk/integrations/openai_agents/spans/invoke_agent.py Show resolved Hide resolved

constantinius added 2 commits January 15, 2026 09:38

fix: review comment

8080904

constantinius added 3 commits January 15, 2026 14:01

Merge shared content transformation functions

4795c3b

refactor(openai): Use shared transform_message_content from ai/utils

df59f49

Replace local _convert_message_parts function with the shared transform_message_content function to deduplicate code across AI integrations.

cursor bot reviewed Jan 15, 2026

View reviewed changes

fix(integrations): openai/openai-agents: convert input message format #5248

Are you sure you want to change the base?

fix(integrations): openai/openai-agents: convert input message format #5248

Conversation

constantinius commented Dec 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Issues

Uh oh!

linear bot commented Dec 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Jan 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Semver Impact of This PR

📋 Changelog Preview

New Features ✨

Bug Fixes 🐛

Documentation 📚

Internal Changes 🔧

Release

Other

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

sentrivana left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

constantinius commented Jan 14, 2026

Uh oh!

Uh oh!

constantinius commented Jan 15, 2026

Uh oh!

cursor bot Jan 15, 2026

Choose a reason for hiding this comment

None content converts to literal string "None"

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

constantinius commented Dec 17, 2025 •

edited

Loading

linear bot commented Dec 17, 2025 •

edited

Loading

github-actions bot commented Jan 13, 2026 •

edited

Loading