Skip to content

Python model kpo support - #122

Merged
gowthamrajj merged 12 commits into
v2.5.0from
python-model-kpo-support
Oct 27, 2026
Merged

gowthamrajj merged 12 commits into
v2.5.0from
python-model-kpo-support

Conversation

@ajayjayendran

Copy link
Copy Markdown
Contributor
  • Add an option to select compute: airflow or kpo, by default airflow in enabled.
  • Updated the relevant skills

@gowthamrajj
gowthamrajj merged commit 88f6590 into v2.5.0 Oct 27, 2026
3 checks passed
@gowthamrajj
gowthamrajj deleted the python-model-kpo-support branch October 27, 2026 10:18
dinpraka pushed a commit that referenced this pull request Oct 27, 2026
* feat(framework): dynamic Lightdash custom granularities and expanded time intervals (#118)

* feat(framework): dynamic Lightdash custom granularities and expanded time intervals

* fix(framework): address PR review comments

* Use materialization in create model (#119)

* add test in workflows before publish and prerelease

* Use materialization in Model Wizard output

* Remove default values from writing to model.json file for materialization fields.
Run format.

* run dj sync

* update fixtures

* npm run lint

* npm run format

* Update example project (#121)

* consolidate two duplicate example dbt projects into one

* fix path reference

* update example model to use materialization and format

* update tags in example project

* update fixtures

* fix npm test due to default text fixtures config

* format docs

* move cli examples to its own folder. copy the cli examples on activation to the dbt project under .dj.

* Python model kpo support (#122)

* Initial changes: Add KPO compute for python models

* Fix: Model Lineage and Create Python model UI Form

* Update modelLineage.ts

* Updated kpo_factory

* Updated Auto discover of upstream sources & external sources

* Update skills

* Update python model skills

* chore(airflow): set xlarge KPO preset memory to 12Gi

Align kpo_factory fallbacks and kpo_sizes.yml with the xlarge pod memory target.

* fix(extension): default python models to Airflow worker

Omit compute in new .python.json unless KPO is chosen; document under 2.5.0 and bump extension version.

* Update dj_etl config keys

* Update FieldSelectSingle.tsx

* Ensure only npmjs.org is used for npm installs (#123)

* add scripts and git hook to verify npm package repository

* run npm audit fix

* run dj sync

* update registry to use public registry if npm config not set. run lint and format.

* Update CHANGELOG.md (#124)

---------

Co-authored-by: Naren Chowdary Ravilla <peals-sharks-2e@icloud.com>
Co-authored-by: gowtham raj j <jgowthamr@gmail.com>
Co-authored-by: Ajayjayendran Arulraj <ajay@hashdhronas.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants