feat: Implement spark materialization engine - #3184

Merged

feast-ci-bot merged 19 commits into

feast-dev:masterfrom

niklasvm:spark_materialization_engine

Sep 15, 2022

Commits on Sep 5, 2022

implement spark materialization engine
niklasvm
committed
26e0b3e
remove redundant code
niklasvm
committed
807e7ca
make function private
niklasvm
committed
f8e70ea
refactor serializing into a class
niklasvm
committed
b42352e
switch to using `foreachPartition`
niklasvm
committed
f609cfb
remove batch_size parameter
niklasvm
committed
79ea412

Commits on Sep 7, 2022

add partitions parameter
niklasvm
committed
937a0e3
linting
niklasvm
committed
610614a
rename spark to spark.offline and spark.engine
niklasvm
committed
84cc858
fix to test
niklasvm
committed
8cc4928
forgot to stage
niklasvm
committed
6a9663d

Commits on Sep 8, 2022

revert spark.offline to spark to ensure backward compatibility
niklasvm
committed
715bb72
Merge branch 'master' into spark_materialization_engine
niklasvm
committed
de1a85a
fix import
niklasvm
committed
32b3111
remove code from testing a large data set
niklasvm
committed
0c13af9
linting
niklasvm
committed
542705f

Commits on Sep 13, 2022

test without repartition
niklasvm
committed
262af10
test alternate connection string
niklasvm
committed
8e59da2
use redis online creator
niklasvm
committed
f828d2b