Skip to content

Commit

Permalink
feat: Add timestamp to batch write logging in SparkKafkaProcessor for…
Browse files Browse the repository at this point in the history
… better traceability
  • Loading branch information
Bhargav Dodla committed Jan 28, 2025
1 parent b5a0ec2 commit cca1df6
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion sdk/python/feast/infra/contrib/spark_kafka_processor.py
Original file line number Diff line number Diff line change
Expand Up @@ -378,8 +378,11 @@ def batch_write(
),
"status int",
).count() # dummy action to force evaluation
current_datetime_with_ms = datetime.now().strftime("%Y-%m-%d %H:%M:%S.%f")[
:-3
]
print(
f"Time taken to write batch {batch_id} is: {(time.time() - start_time) * 1000:.2f} ms"
f"{current_datetime_with_ms} Time taken to write batch {batch_id} is: {(time.time() - start_time) * 1000:.2f} ms"
)

def batch_write_with_connector(
Expand Down

0 comments on commit cca1df6

Please sign in to comment.