This Week in Databend #78

Databend is a powerful cloud data warehouse. Built for elasticity and efficiency. Free and open. Also available in the cloud: https://app.databend.com .

What's New

Check out what we've done this week to make Databend even better for you.

Features & Improvements ✨

SQL

eliminate extra group by scalars (#9708)

Query

add privilege check for insert/delete/optimize (#9664)
enable empty projection (#9675)
add aggregate limit in final aggregate stage (#9716)
add optional column names to create/alter view statement (#9715)

Storage

add prewhere support in native storage format (#9600)

Code Refactoring 🎉

move io constants to common/io (#9700)
refine fuse/io/read (#9711)

Planner

rename Scalar to ScalarExpr (#9665)

Storage

refactor cache layer (#9672)
pruner.rs -> fuse_bloom_pruner.rs (#9710)
make pruner hierarchy to chain (#9714)

Build/Testing/CI Infra Changes 🔌

support setup minio storage & external s3 storage in docker image (#9676)

Bug Fixes 🔧

Expression

fix missing simple_cast (#9671)

Query

fix efficiently_memory_final_aggregator result is not stable (#9685)
fix max_result_rows only limit output results nums (#9661)
fix query hang in two level aggregator (#9694)

Storage

may get wrong datablocks if not sorted by output schema (#9470)
bloom filter is using wrong cache key (#9706)

What's On In Databend

Stay connected with the latest news about Databend.

Databend All-in-One Docker Image

Databend Docker Image now supports setting up MinIO storage and external AWS S3 storage.

Now you can easily use a Docker image for your first experiment with Databend.

Run with MinIO as backend

docker run \
    -p 8000:8000 \
    -p 9000:9000 \
    -e MINIO_ENABLED=true \
    datafuselabs/databend

Run with self managed query config

docker run \
    -p 8000:8000 \
    -e DATABEND_QUERY_CONFIG_FILE=/etc/databend/mine.toml \
    -v query_config_file:/etc/databend/mine.toml \
    datafuselabs/databend

Learn More

What's Up Next

We're always open to cutting-edge technologies and innovative ideas. You're more than welcome to join the community and bring them to Databend.

Vector Search

Vector search captures the meaning and context of unstructured data, and is commonly used for text or image processing, enabling the use of semantics to find similar results and obtain more valid results than traditional keyword retrieval.

Databend plans to provide users with a richer and more efficient means of querying by supporting vector search, and the introduction of Faiss Index may be an initial solution.

Issue 9699: feat: vector search (Faiss index)

Please let us know if you're interested in contributing to this issue, or pick up a good first issue at https://link.databend.rs/i-m-feeling-lucky to get started.