Kafka consumer manager handles retries, offset issues and retries
build schema with validators for each endpoint