Scaling Event Processing and Analytics in the Data Lake: High-Performance Ingestion and Storage Into 3K Delta Tables With Spark Streaming