Comunica SPARQL Link Traversal

Comunica SPARQL Link Traversal Solid is a SPARQL query engine for JavaScript that follows links across documents within Solid data pods.

Warning: due to the uncontrolled nature of the Web, it is recommended to always enable lenient mode when doing link traversal.

This module is part of the Comunica framework.

Install

$ yarn add @comunica/query-sparql-link-traversal-solid

or

$ npm install -g @comunica/query-sparql-link-traversal-solid

Usage

Execute a query over a Solid pod by authenticating through the https://solidcommunity.net/ identity provider (when using https://pod.inrupt.com/, your IDP will be https://login.inrupt.com/):

$ comunica-sparql-link-traversal-solid --idp https://solidcommunity.net/ \
  "PREFIX snvoc: <https://solidbench.linkeddatafragments.org/www.ldbc.eu/ldbc_socialnet/1.0/vocabulary/>
  SELECT DISTINCT ?forumId ?forumTitle WHERE {
    ?message snvoc:hasCreator <https://solidbench.linkeddatafragments.org/pods/00000006597069767117/profile/card#me>.
    ?forum snvoc:containerOf ?message;
      snvoc:id ?forumId;
      snvoc:title ?forumTitle.
  }" --lenient

This command will connect with the given identity provider, and open your browser to log in with your WebID. After logging in, the query engine will be able to access all the documents you have access to.

If you want to disable the login step, you can pass --idp void.

If no sources are provided, the URLs inside the query will be considered starting sources. Since passing sources is optional, the following is equivalent:

$ comunica-sparql-link-traversal-solid https://solidbench.linkeddatafragments.org/pods/00000006597069767117/profile/card \
 --idp https://solidcommunity.net/ \
  "PREFIX snvoc: <https://solidbench.linkeddatafragments.org/www.ldbc.eu/ldbc_socialnet/1.0/vocabulary/>
  SELECT DISTINCT ?forumId ?forumTitle WHERE {
    ?message snvoc:hasCreator <https://solidbench.linkeddatafragments.org/pods/00000006597069767117/profile/card#me>.
    ?forum snvoc:containerOf ?message;
      snvoc:id ?forumId;
      snvoc:title ?forumTitle.
  }" --lenient

Show the help with all options:

$ comunica-sparql-link-traversal-solid --help

Just like Comunica SPARQL, a dynamic variant (comunica-dynamic-sparql-link-traversal) also exists.

Read more about querying from the command line.

Usage within application

This engine can be used in JavaScript/TypeScript applications as follows:

const QueryEngine = require('@comunica/query-sparql-link-traversal-solid').QueryEngine;
const {interactiveLogin} = require('solid-node-interactive-auth');

// This will open your Web browser to log in
const session = await interactiveLogin({oidcIssuer: 'https://solidcommunity.net/'});
const myEngine = new QueryEngine();

const bindingsStream = await myEngine.queryBindings(`
  PREFIX snvoc: <https://solidbench.linkeddatafragments.org/www.ldbc.eu/ldbc_socialnet/1.0/vocabulary/>
  SELECT DISTINCT ?forumId ?forumTitle WHERE {
    ?message snvoc:hasCreator <https://solidbench.linkeddatafragments.org/pods/00000006597069767117/profile/card#me>.
    ?forum snvoc:containerOf ?message;
      snvoc:id ?forumId;
      snvoc:title ?forumTitle.
  }`, {
    // Sources field is optional. Will be derived from query if not provided.
    //sources: [session.info.webId], // Sets your profile as query source
    '@comunica/actor-http-inrupt-solid-client-authn:session': session,
    lenient: true,
});

// Consume results as a stream (best performance)
bindingsStream.on('data', (binding) => {
    console.log(binding.toString()); // Quick way to print bindings for testing

    console.log(binding.has('s')); // Will be true

    // Obtaining values
    console.log(binding.get('s').value);
    console.log(binding.get('s').termType);
    console.log(binding.get('p').value);
    console.log(binding.get('o').value);
});
bindingsStream.on('end', () => {
    // The data-listener will not be called anymore once we get here.
});
bindingsStream.on('error', (error) => {
    console.error(error);
});

// Consume results as an array (easier)
const bindings = await bindingsStream.toArray();
console.log(bindings[0].get('s').value);
console.log(bindings[0].get('s').termType);

Read more about querying an application.

Usage as a SPARQL endpoint

Start a webservice exposing traversal via the SPARQL protocol, i.e., a SPARQL endpoint, by authenticating through the https://solidcommunity.net/ identity provider.

$ comunica-sparql-link-traversal-solid-http --idp https://solidcommunity.net/ \
  --lenient

Start a webservice exposing traversal from https://www.rubensworks.net/ via the SPARQL protocol, i.e., a SPARQL endpoint, by authenticating through the https://solidcommunity.net/ identity provider.

$ comunica-sparql-link-traversal-solid-http --idp https://solidcommunity.net/ \
  https://www.rubensworks.net/ --lenient

Show the help with all options:

$ comunica-sparql-link-traversal-solid-http --help

The SPARQL endpoint can only be started dynamically. An alternative config file can be passed via the COMUNICA_CONFIG environment variable.

Use bin/http.js when running in the Comunica monorepo development environment.

Read more about setting up a SPARQL endpoint.