gendatabricks

Overview ¶

Package main provides a web scraper that extracts Databricks SQL function metadata from the Databricks documentation and generates Go code for the dialect package.

Usage:

go run ./scripts/gendatabricks -gen=all -outdir=pkg/dialects/databricks/
go run ./scripts/gendatabricks -gen=functions -out=pkg/dialects/databricks/functions_gen.go
go run ./scripts/gendatabricks -gen=keywords -out=pkg/dialects/databricks/keywords_gen.go
go run ./scripts/gendatabricks -gen=types -out=pkg/dialects/databricks/types_gen.go

The scraper fetches function names from the alphabetical list, then concurrently fetches documentation from each individual function page for full coverage.