Logging in Python with OpenTelemetry

Learn how to set up highlight.io with logs from Python using OpenTelemetry.

1

Set up OpenTelemetry for logging.

Configure OpenTelemetry to send logs to highlight.io without requiring the Highlight SDK.

import logging from opentelemetry import trace from opentelemetry._logs import set_logger_provider from opentelemetry.exporter.otlp.proto.grpc._log_exporter import OTLPLogExporter from opentelemetry.sdk._logs import LoggerProvider, LoggingHandler from opentelemetry.sdk._logs.export import BatchLogRecordProcessor from opentelemetry.sdk.resources import Resource import sys # Define the service name and environment service_name = "my-service" environment = "production" # Create a resource with service name and highlight project ID resource = Resource.create({ "service.name": service_name, "highlight.project_id": "<YOUR_PROJECT_ID>", "environment": environment }) # Set up the logger provider with the resource logger_provider = LoggerProvider(resource=resource) set_logger_provider(logger_provider) # Configure the OTLP log exporter exporter = OTLPLogExporter(endpoint="https://otel.highlight.io:4317", insecure=True) logger_provider.add_log_record_processor(BatchLogRecordProcessor(exporter)) # Set up the logger logger = logging.getLogger(service_name) logger.setLevel(logging.DEBUG) # Add the OpenTelemetry logging handler handler = LoggingHandler(level=logging.DEBUG, logger_provider=logger_provider) logger.addHandler(handler) # Add console handler for stdout (optional) console_handler = logging.StreamHandler(sys.stdout) console_handler.setLevel(logging.DEBUG) formatter = logging.Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s') console_handler.setFormatter(formatter) logger.addHandler(console_handler)

2

Send logs using OpenTelemetry!

Logs are reported automatically from OpenTelemetry logging methods. Visit the highlight logs portal and check that backend logs are coming in.

import logging from opentelemetry import trace tracer = trace.get_tracer(__name__) def main(): with tracer.start_as_current_span("example-span"): logger.info('hello, world!') logger.warning('whoa there', {'key': 'value'})

3

Verify your backend logs are being recorded.

Visit the highlight logs portal and check that backend logs are coming in.