v0.5.22

Internal tasks

• Re-release of v0.5.20...v0.5.21

Full Changelog: v0.5.21...v0.5.22

v0.5.21

Enhancements

• Store error messages by @kevinwallimann in #827, #841
• Regularly execute archive_dag_instances function by @jozefbakus in #828, #842

Internal tasks

• Github release, deploy actions by @jozefbakus in #839

Dependencies

• Bump jszip from 3.7.1 to 3.10.1 in /ui by @dependabot in #781

Application properties change
New

• sparkYarnSink.saveDiagnostics (not mandatory). Valid values: true, false. Default value: false

Full Changelog: v0.5.20...v0.5.21

v0.5.20

Internal tasks

• Re-release of v0.5.18...v0.5.19

Full Changelog: v0.5.19...v0.5.20

v0.5.19

Internal tasks

• #816: S3a support for ingestion status

Full Changelog: v0.5.18...v0.5.19

v0.5.18

Bugfixes

• #801: Not triggered workflows with time schedule

Full Changelog: v0.5.17...v0.5.18

v0.5.17

Internal tasks

• #803 Replace mutable.Map with concurrent.TrieMap in JobScheduler for runningDags
• #802 Added extra logging
• #807 Add maven compiler source and target
• Fixes related to hortonworks repository outage
• Fixes related to feature: "messages to ingest"

Full Changelog: v0.5.16...v0.5.17

v0.5.16

Enhancements

• #788 Workflows case insensitive filter
• #783 Verify read and write permissions to a kafka topic in Hyperdrive jobs
• #789 Show number of messages to ingest in Hyperdrive jobs

Application properties changes
New

• confluent.baseUrls. Mandatory. Confluent base url.
• confluent.authPath. Mandatory. Confluent auth path.
• confluent.user. Mandatory. Confluent user used to authenticate.
• confluent.base64Credentials. Mandatory. Password for confluent user.
• confluent.clusterType. Mandatory. Cluster type.
• confluent.kafkaClusterId. Mandatory. Cluster id.
• confluent.retries. Mandatory. Number of retries.

Full Changelog: v0.5.15...v0.5.16

v0.5.15

Bugfixes

• #778 Runs details switch between rows shows incorrect data

Internal tasks

• #743 Removed testing properties for hyperdrive executor
• #752 Fixed maven compiler warnings
• #752 Fixed ui compiler warnings

Removed

• scheduler.executors.enableHyperdriveExecutor

Full Changelog: v0.5.14...v0.5.15

v0.5.14

Enhancements

• #769 Removed Shell job support in UI

Bugfixes

• #718 Unsubscribe in ui component
• #758 Fixed failing notification rule validation service test

Internal tasks

• #750 Fixed vulnerabilities from maven central
• #745 Removed deprecated columns from DB
• #749 Added github issue templates
• #754 #757 Added documentation for archive_dag_instances query
• #751 clarity and angluar upgrade (clarity 13.0.2 -> 13.11.1, angular 13.2.3 -> 14.2.12)
• #747 Bump decode-uri-component from 0.2.0 to 0.2.2 in /ui
• #753 Bump qs from 6.5.2 to 6.5.3 in /ui
• #759 Bump loader-utils from 2.0.2 to 2.0.4 in /ui
• #766 Bump json5 from 1.0.1 to 1.0.2 in /ui

Full Changelog: v0.5.13...v0.5.14

v0.5.13

Bugfixes

• #738: Self-Resurrecting scheduler
• #736: Always catch up on missed kafka notifications
• #731: Multi user spark-job execution.
• #727: Application should not fail when hadoop-binaries are missing

Internal tasks

• #723: Upgraded node and npm
• #720: Archiving for Instances

Application properties changes
New

• scheduler.executors.enableHyperdriveExecutor. Optional, default value true. Should be set to false, if hadoop-binaries are not on the classpath
• kafkaSource.always.catchup. Optional, default value true. Whether to catch up on missed kafka message in kafka sensors.