SALURBAL Cube Exploration

Author

Ran Li (Maintainer)

Published

October 3, 2024

The goal of this is to have a only EDA of salurbal metadata cubes. Some milestones to tests:

Quarto-live just test
Does required dependencies have WASM
- Arrow (No yet)
- Duckdb (yes!)
- Dplyr (yes!)
Parquet file hosting
- Can we deploy a parquet file with a quarto-live document?
- If not can we have it somewhere where WASM arrow cna connect

Importing data

This is the question. Can we import data from a parquet file?

Lets see if that table gets passed onto webr

---
title: "SALURBAL Cube Exploration"
author:
  - name: Ran Li (Maintainer)
    orcid: 0000-0002-4699-4755
date: last-modified
format:
  live-html:
    toc: true
    self-contained: true
    code-fold: false
    df-print: kable
    code-tools: true
webr:
  packages:
    - dplyr
    - duckdb
comments:
  hypothesis:
    theme: clean
editor: source
execute:
  warning: false
  message: false
  eval: true
editor_options:
  chunk_output_type: console
---

The goal of this is to have a only EDA of salurbal metadata cubes. Some milestones to tests:


- Quarto-live just test
- Does required dependencies have WASM
    - Arrow (No yet)
    - Duckdb  (yes!)
    - Dplyr (yes!)
- Parquet file hosting
    - Can we deploy a parquet file with a quarto-live document?
    - If not can we have it somewhere where WASM arrow cna connect




# Importing data

This is the question. Can we import data from a parquet file?
```{webr}
sessionInfo()
```

```{webr}
#| edit: false


library(dplyr)
library(duckdb)

url <- "https://huggingface.co/datasets/SALURBAL/salurbal-metadata/resolve/refs%2Fconvert%2Fparquet/default/train/0000.parquet"

# Create a connection to DuckDB
con <- dbConnect(duckdb())

# Install and load the httpfs extension
dbExecute(con, "INSTALL httpfs;")
dbExecute(con, "LOAD httpfs;") 

## Query
result <- dbGetQuery(con, sprintf("SELECT * FROM parquet_scan('%s') LIMIT 5", url))
```

Lets see if that table gets passed onto webr

```{webr}
head(result)
```