This Week in Databend #73

Databend is a powerful cloud data warehouse. Built for elasticity and efficiency. Free and open. Also available in the cloud: https://app.databend.com .

What's New

Check out what we've done this week to make Databend even better for you.

Features & Improvements ✨

Multiple Catalogs

implement show tables (from|in catalog.database) (#9153)

Planner

introduce histogram in column statistics (#9310)

Query

support attaching stage for insert values (#9249)
add native format in fuse table (#9279)
add internal_enable_sandbox_tenant config and sandbox_tenant (#9277)

Sqllogictest

introduce rust native sqllogictest framework (#9150)

Code Refactoring 🎉

unify apply_file_format_options for copy & insert (#9323)

remove unused code (#9266)

meta

test watcher count (#9324)

Planner

replace TableContext in planner with PlannerContext (#9290)

Bug Fixes 🔧

Base

try fix SIGABRT when catch unwind (#9269)
replace #[thread_local] to thread_local macro (#9280)

Query

fix unknown database in query without relation to this database (#9250)
fix wrong current_role when drop the role (#9276)

What's On In Databend

Stay connected with the latest news about Databend.

Introduced a Rust Native Sqllogictest Framework

Sqllogictest verifies the results returned from a SQL database engine by comparing them with the results of other engines for the same queries.

In the past, Databend ran such tests using a program written in Python and migrated a large number of test cases from other popular databases. We implemented the program again with sqllogictest-rs in recent days.

Learn More

Experimental: Native Format

PA is a native storage format based on Apache Arrow. Similar to Arrow IPC, PA aims at optimizing the storage layer.

Databend is introducing PA as a native storage format in the hope of getting a performance boost, though it's still at an early stage of development.

create table tmp (a int) ENGINE=FUSE STORAGE_FORMAT='native';

Learn More

What's Up Next

We're always open to cutting-edge technologies and innovative ideas. You're more than welcome to join the community and bring them to Databend.

Checking File Existence Before Returning Presigned URL

When presigning a file, Databend currently returns a potentially valid URL based on the filename without checking if the file really exists. Thus, the 404 error might occur if the file doesn't exist at all.

Issue 8702: Before return presign url add file exist judgement

Please let us know if you're interested in contributing to this issue, or pick up a good first issue at https://link.databend.rs/i-m-feeling-lucky to get started.