I am trying to develop one simple streaming application. My code is working fine in batch processing but when i am dealing with streaming data, I am facing issue while writing the output to console.
Below code i am using for console output:
query = hashtags_count
.writeStream
.format("console")
.option("checkpointLocation", "chk-point-dir")
.outputMode("complete")
.start()
Error message:
ERROR StreamMetadata: Error writing stream metadata StreamMetadata(7db81fcd-b040-47cb-a857-04c84af53a6b)
I have installed spark locally on windows.
Please help to fix this issue