Skip to content

Commit beac9e7

Browse files
author
Bhargav Dodla
committed
refactor: Move unserialization of artifacts outside the loop in spark_materialization_engine
1 parent fb70203 commit beac9e7

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

sdk/python/feast/infra/materialization/contrib/spark/spark_materialization_engine.py

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -235,6 +235,13 @@ def _map_by_partition(
235235
):
236236
feature_view, online_store, repo_config = spark_serialized_artifacts.unserialize()
237237
"""Load pandas df to online store"""
238+
239+
# unserialize artifacts
240+
(
241+
feature_view,
242+
online_store,
243+
repo_config,
244+
) = spark_serialized_artifacts.unserialize()
238245
for pdf in iterator:
239246
pdf_row_count = pdf.shape[0]
240247
start_time = time.time()

0 commit comments

Comments
 (0)