Repository navigation
Conversation
…time intervals (#118) * feat(framework): dynamic Lightdash custom granularities and expanded time intervals * fix(framework): address PR review comments
* add test in workflows before publish and prerelease * Use materialization in Model Wizard output * Remove default values from writing to model.json file for materialization fields. Run format. * run dj sync * update fixtures * npm run lint * npm run format
* consolidate two duplicate example dbt projects into one * fix path reference * update example model to use materialization and format * update tags in example project * update fixtures * fix npm test due to default text fixtures config * format docs * move cli examples to its own folder. copy the cli examples on activation to the dbt project under .dj.
* Initial changes: Add KPO compute for python models * Fix: Model Lineage and Create Python model UI Form * Update modelLineage.ts * Updated kpo_factory * Updated Auto discover of upstream sources & external sources * Update skills * Update python model skills * chore(airflow): set xlarge KPO preset memory to 12Gi Align kpo_factory fallbacks and kpo_sizes.yml with the xlarge pod memory target. * fix(extension): default python models to Airflow worker Omit compute in new .python.json unless KPO is chosen; document under 2.5.0 and bump extension version. * Update dj_etl config keys * Update FieldSelectSingle.tsx
* add scripts and git hook to verify npm package repository * run npm audit fix * run dj sync * update registry to use public registry if npm config not set. run lint and format.
gowthamrajj
approved these changes
Oct 27, 2026
dinpraka
approved these changes
Oct 27, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Changes
Python models
.python.jsonfiles omitcompute(Create Python Model defaults to Airflow worker). Set"compute": "kpo"and optionalkpo_sizeto run on Kubernetes; pod presets remain indags/_ext_/kpo_sizes.yml.depends_onupstream inference. When DJ auto-fills trinoupstream_sourcesfromdepends_on, catalog and schema resolve fromdj.pythonModel.catalogName/dj.pythonModel.databaseName(mirrors Airflow Variablesdj_python_model_catalog_nameanddj_python_model_database_name), KPO env vars, thenglueandpython_source— not hardcoded org catalogs.python_models/_trino_io.pyand KPO pod env readdj_etl_trino_host,dj_etl_trino_user, anddj_etl_trino_passwordinstead of legacyopus-etl-*names.Model Wizard
materializationinstead of deprecated top-level fields. The wizard writesmaterialization(string or nested strategy/partitions) rather thanmaterialized,incremental_strategy, andpartitioned_by. Saving an edit removes those legacy keys from the file. jaffle_shop examples use the new shape.Agent / CLI
.dj/examples/on activation, sodj <operation> --helpand the agent skills point at files that exist in your project.Framework
lightdash.config.yml(undercustom_granularities) are dynamically discovered and loaded into model schemas and editor autocomplete. Built-in time intervals also now includeMINUTE,SECOND, andMILLISECOND.Documentation
jaffle_shopexample project. Consolidates the two duplicate example dbt projects into one atdocs/examples/jaffle_shop, which now includes the Lightdash examples. Docs, links, and the example walkthroughs point at this single project.