This Week in Databend #75

Databend is a powerful cloud data warehouse. Built for elasticity and efficiency. Free and open. Also available in the cloud: https://app.databend.com .

What's New

Check out what we've done this week to make Databend even better for you.

Features & Improvements ✨

Format

basic output format JSON (#9447)

Query

check connection params (#9437)
add max_query_row_nums (#9406)

Storage

support prewhere in hive (#9427)
add generic cache trait for different object reader (#9436)
add metrics for new cache (#9445)

New Expression

migrate hash func to func-v2 (#9402)

Sqllogictest

run all tests in parallel (#9400)

Code Refactoring 🎉

Storage

add to_bytes and from_bytes for CachedObject (#9439)
better table-meta and parquet reader function (#9434)
convert fuse_snapshot unit tests to sqlloigc test (#9428)

Bug Fixes 🔧

Format

catch unwind when read split (#9420)

User

lazy load JWKS (#9446)

Planner

create Stage URL's path should ends with / (#9450)

What's On In Databend

Stay connected with the latest news about Databend.

Databend 2022 Recap

Let's look back and see how Databend did in 2022.

Open source: got 2,000+ stars, merged 2,400+ PRs, and solved 1,900 issues.
From data warehouse to lakehouse: Brand-new design with enhanced capabilities.
Rigorous testing: SQL Logic Tests, SQLancer, and https://perf.databend.rs.
Building the ecosystem: More customers chose, trusted, and grew with Databend, including Kuaishou and SAP.
Databend Cloud: Built on top of Databend, the next big data analytics platform.

We wish everyone a Happy New Year and look forward to engaging with you.

Learn More

Blog | Databend 2022 Recap

Databend 2023 Roadmap

As the new year approaches, Databend is also actively planning its roadmap for 2023.

We will continue to polish the Planner and work on data and query caching. Enhancing storage and query issues for PB-level data volumes is also on our list.

Try Databend and join the roadmap discussion.

Learn More

Issue | Roadmap 2023

What's Up Next

We're always open to cutting-edge technologies and innovative ideas. You're more than welcome to join the community and bring them to Databend.

Profile-Guided Optimization (PGO)

The basic concept of PGO is to collect data about the typical execution of a program (e.g. which branches it is likely to take) and then use this data to inform optimizations such as inlining, machine-code layout, register allocation, etc.

rustc supports doing profile-guided optimization (PGO). We expect to be able to use it to enhance the build.

Issue 9387: Feature: Add PGO Support

Please let us know if you're interested in contributing to this issue, or pick up a good first issue at https://link.databend.rs/i-m-feeling-lucky to get started.