LibSQL: Query a remote Turso database with cURL

Wed, 15 Nov 2023 00:00:00 UTC

If you are using a local [libsql](https://turso.tech/libsql) database, it is quite easy to query the database, but for a remote or a database on a hosted cloud platform like [turso](https://turso.tech/), we can use other clients or the api itself to query the data. We can use the turso cli to get the authentication token for the database and then query the database. ## Turso CLI Using the [turso-cli](https://docs.turso.tech/reference/turso-cli) to access the turso platform. We will use turso cli to create a libsql database, create authentication tokens, and query the db. ### Create a database (it's optional, you might already have a database) ```bash turso db create ``` You will get a database on the turso cloud platform with some random interesting name like a passphrase. Use the command `turso db list` and copy the URL ```graphql DB_URL=dbname-orgname.turso.io ``` ### Create an authentication token for a particular database ```bash turso db tokens create db_name ``` Copy the JWT token and this will be used as a authentication token when accessing the remote database in the turso cloud. ```bash TOKEN=abcdef.12345.wxyz DB_URL=dbname-orgname.turso.io ``` * Querying the database using curl or other [api clients](https://docs.turso.tech/libsql/client-access) ```bash curl -s -H "Authorization: bearer $TOKEN" \ -d '{"statements": ["SELECT name FROM sqlite_master WHERE type=\"table\";"]}' \ $DB_URL ``` We can use `curl` or any api client tools to send queries to the database hosted on the turso platform. We need to provide the JWT token in the `Authorization` header to connect to that particular database. The request's body is a JSON string with a list of statements to query the database. ```graphql [ { "results": { "columns": ["name"], "rows":[ ["libsql_wasm_func_table"], ["_litestream_seq"], ["_litestream_lock"], ["sqlite_sequence"], ["user"] ] } } ] ``` The result is a list of key-value pairs as `columns` and `rows` for each of the statements in the body. The columns are a list of column names requested in the query, and the rows are a list of rows where each row is a list of field values from the query.

Basics of curl command

Fri, 05 Nov 2021 00:00:00 UTC

## Introduction We all might have used the curl command but might be unaware of it. It's super old and still serves a great purpose. It has been available since 1996 and still is widely used in many embedded technologies, web API testing, CLI applications, etc. In this article, we'll see some basics of using the curl command along with its applications. ## What is the curl command? Curl or cURL command is the utility or tool to access the internet from the command line interface using various protocols. This looks trivial but it can blow up your mind! Most people use this tool for fetching and processing the data from the servers/internet from their terminal without the browser but there is a lot more to it. It is used in various embedded devices for accessing the network in a lightweight and accessible way. Let's see how you can use the curl command from the very basics. ## Why do we need it? Before we talk about how to use the curl command let's talk about why might we need that? There are a lot of reasons and it even depends on the application you are using. You can use curl to test your API, well there are other tools like POSTMAN, Insomnia, etc but for keeping things simple you can quickly get in with curl and test some endpoints. You might require curl for creating some CLI applications that require fetching/posting to an URL over the internet. If you are using the terminal, curl integrates really very well with the shell programming languages like BASH, ZSH, etc So, after making WHY out of the way, let's start with the actual content. ## Structure of curl command **curl or Client URL is a command-line utility that helps in accessing/posting data with various protocols over the internet.** It basically serves as a bare-bones browser URL search bar. You can't render those pages like the actual GUI, and all but you can get is the HTML source code, JSON response, etc. That's still quite powerful and used in tons of applications. ``` curl URL arguments ``` The above is a basic structure of the curl command. We see the argument structure in-depth in the next section. Firstly, let's take a simple curl command with just the URL is given. ```bash curl "https://github.com" ``` From this query to `github.com`, you are literally going to `GitHub.com` and getting a response as the entire HTML source code of the page. If you don't want to spam the output in the terminal, you can redirect the output to a file. ```bash curl "https://github.com" >temp.html ``` With this command, we store the output of the command in the file temp.html, it can be any other file you like. ### Arguments It turns out that you can even parse in certain arguments to the `curl` command to get some desired and modified results. Let's take a look at some of them. The [entire list of arguments](https://curl.se/docs/manpage.html) is quite huge and baffling, but this shows how customizable the command is. - `-s` (silent the progress bar) - `-X` (web requests `POST, GET, etc` to the URL) - `-o` (output to a file) - `-H` ( provide Header to the request) - `-d` (providing the data e.g. in POST request) ```bash curl -s -o "https://github.com" temp.html ``` This command doesn't load the progress bar and simply outputs the response in a file, making the execution process in the terminal clean. ### Integration with other commands As said, the `curl` command can be well integrated with the other commands using piping in shell, assigning to variables, and so on. Let's see how we can convert the `JSON` response to a BASH variable. ```bash resp=$(curl -H "api-key: N2vDzMyEeYGTxjUTePhC8bYd" https://dev.to/api/users/me) echo $resp ``` Here, we are fetching the `JSON` response from the `dev.to` [API](https://developers.forem.com/api/),The wired string `N2vDzMyEeYGTxjUTePhC8bYd` is my [dev.to API token](https://dev.to/settings/account)(don't worry I have revoked it:) ) we have provided an argument `-H` that is a Header for accepting a `Json` response. We can store the contents of the curl command by using the `$( )` and assigning that to the variable name of your choice. ```bash username=$(curl -H "api-key: N2vDzMyEeYGTxjUTePhC8bYd" https://dev.to/api/users/me | grep -o -P '(?<=username":").*(?=","name)') ``` Here, we have stored the username from a `JSON` response to the variable username. We have piped the curl command so that we can work with that `JSON` response and modify the contents and then store the final results in a variable. In this case, we are using `grep` to filter out the content between the key `username` and `name`, thus we get the value we desired. To see the value you can always run the echo command as below: ```bash echo $username ``` So, that's how the `curl` command integrates flawlessly with BASH and other shell programming languages. ## Where is it used? `curl` is actually used in API testing, CLI applications, Web Scrapping, etc. It's a great tool for terminal lovers. Let's see where we can use the curl command actually to make some good projects. ### API Testing We can use, `curl` to test an API, it might be API you would have made or to simply test and play with other API available publicly. You can get an in-depth guide about [Testing a REST API with curl](https://www.codepedia.org/ama/how-to-test-a-rest-api-from-command-line-with-curl/). Actually, curl can do more than just testing, I have made a [bash script](https://gist.github.com/Mr-Destructive/80860664b1014ef0b94092d68ead1044) that actually posts some data over a database through the API so that I don't have to do that manually. That is the kind of automation I love to do and curl! Just did that. ### Web Scrapping Web-scrapping is usually trending with Python, but I have done that with BASH. That might be an outdated idea but is a good task to learn the basics of Web-scrapping with BASH ;). I must say that sed, awk, grep are the tools are powerful like heck in doing these tricks. I have made this [crypto-currency](https://mr-destructive.github.io/techstructive-blog/bash/2021/07/15/BASH-Crypto-Coingecko.html) and [dictionary](https://mr-destructive.github.io/techstructive-blog/bash/2021/07/27/BASH-script-dictionary-scrap.html) scrapper with BASH. Web-scrapping can be done with the curl command by fetching to an API if any or any website. We need to search and find the particular fields, classes, or ids the elements the required data might be into and then extract and filter using the tools like grep, sed or awk. ### CLI Applications We can make CLI applications like creating a terminal view of existing applications using their APIs or website. I recently made a CLI for [cross-posting articles](https://github.com/Mr-Destructive/crossposter) to dev. to, hashnode and medium. That is a project still in progress(tons of bugs) but still serving a decent job. Definitely `curl` might not be the only command that works here, but the project might look so incomplete without `curl`. **There might be other applications as well, who knows there is a lot to do with this command.** If you know one, please let everyone know in the comments. ### References: Special Thanks to the creator of the curl command - [Magnus Daniel Stenberg](https://github.com/bagder) and the developers who are still contributing and maintaining the great project. ### Conclusion So, from this article, we were able to understand the basics of the `curl` command and understand its applications in actual programming stuff. Hope you liked it. Thanks for reading and until then Happy Coding :)

Meet Gor - Tag: curl

LibSQL: Query a remote Turso database with cURL

Basics of curl command