More Mirrors

Censorship resilient and distributed publishing. This repository contains a collection of scripts and tools to help you run your own censorship resilient web services. We mostly use Service Workers to achieve this.

Installation

npm install more-mirrors

Table of contents

• Getting started
  • Usage
  • Configuration
• Bookmarking
  • Usage
  • API endpoints
  • Examples
• Fallback pages
  • Usage
  • Options
  • Examples
• Fallback assets
  • Usage
  • Options
• Content bundles
  • Usage
  • Options
• Fallback image
  • Usage
• UI components
  • Bookmark button
  • Traffic light

Getting started

To ensure smooth integration between our modules it is necessary to use the registerServiceWorkerController function. Make sure to include it in the options parameter when calling one of the modules, as illustrated below.

Usage

Inside your service worker:

import { registerBookmarkApi, registerServiceWorkerController } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerBookmarkApi({ serviceWorkerController });

Configuration

Individual modules can be configured by passing an object when calling the module function from your service worker. Next to that you can also configure all modules from one configuration file. You need to host that file on your server and pass the path of the file as a url parameter to your service worker registration path, as illustrated below.

From the client:

if ('serviceWorker' in navigator) {
  window.addEventListener('load', () => {
    const configurationVersion = 1;
    const serviceWorkerUrl = `/service-worker.js?configuration=${encodeURIComponent(`/static/service-worker-configuration.json?v=${configurationVersion}`)}`;
    navigator.serviceWorker
      .register(serviceWorkerUrl)
      .then((registration) => registration.update())
  });
}

Make sure to revision hash or version the configuration file, so that you can update it without having to update your service worker.

The configuration file should look like this, all modules are optional.

{
  "bookmark": {},
  "fallbackPages": {},
  "fallbackAssets": {}
}

For more information about the configuration options, see the documentation of the individual modules.

Timeout

The default timeout for network requests is 3 seconds. To adjust this timeout, pass it as an option while creating the Service Worker Controller:

const serviceWorkerController = registerServiceWorkerController({
  networkTimeoutSeconds: 10,
});

Bookmarking

We provide some API endpoints defined in the service worker to save pages for offline availability.

Usage

Inside your service worker:

import { registerBookmarkApi, registerServiceWorkerController } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerBookmarkApi({ serviceWorkerController });

When your service worker is installed, you can now call the bookmark API, which is available at /more-mirrors/bookmark/.

API endpoints

GET /more-mirrors/bookmark/

Get all pages from the bookmark cache.

Response

An array of bookmarked pages.

Example

fetch('/more-mirrors/bookmark/', { method: 'GET' })
  .then(response => response.json())
  .then(pages => {
    console.log(pages);
  });

GET /more-mirrors/bookmark/{path}

Get a single page from the bookmark cache. Where the path is a url encoded path.

Response

200: A single bookmarked page.

404: The page was not found in the bookmark cache.

400: The path is not a valid url encoded path.

Example

fetch('/more-mirrors/bookmark/%2Fpath%2Fto%2Fthe%2Fpage%2F', { method: 'GET' })
  .then(response => response.json())
  .then(page => {
    console.log(page);
  });

POST /more-mirrors/bookmark/{path}

Add a page to the bookmark cache. Where the path is a url encoded path.

Request body

Example

fetch('/more-mirrors/bookmark/%2Fpath%2Fto%2Fthe%2Fpage%2F', {
  method: 'POST',
  headers: {
    'Content-Type': 'application/json'
  },
  body: JSON.stringify({ metadata: { title: 'Page title' } }),
});

DELETE /more-mirrors/bookmark/{path}

Delete a page from the bookmark cache. Where the path is a url encoded path.

Example

fetch('/more-mirrors/bookmark/%2Fpath%2Fto%2Fthe%2Fpage%2F', { method: 'DELETE' });

Fallback pages

We provide a fallback strategy for pages to use when the network is not available.

Usage

Inside your service worker:

import { registerFallbackPages, registerServiceWorkerController } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerFallbackPages({ serviceWorkerController });

Calling registerFallbackPages is enough to get you started. It will render a default offline page whenever the network is not available. By default, it looks like this:

This page is somewhat customizable, it has support for basic theming and the default UI texts can be overwritten. However, in case this is not enough, we also support custom offline pages:

import { registerFallbackPages, registerFallbackHandlersPlugin } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerFallbackPages({
  serviceWorkerController,
  pages: [{
    url: '/my-offline-page/',
    revision: '1',
  }],
});

revision is not required, but it is highly recommended. Changing this value will cause a cache invalidation, which means we will re-cache the latest version.

⚠️ Please note that this module takes over the /more-mirrors/dashboard/ route regardless of the user's online status. The route is used to make the default offline page available for online users.

Options

Pass an object with the following properties to the registerFallbackPages function:

customProperties

A list of all the over writable custom properties and their default values.

templateStrings

A list of all the over writable UI text strings and their default values.

Examples

Default offline page with customization

import { registerFallbackPages, registerServiceWorkerController } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerFallbackPages({
  serviceWorkerController,
  customProperties: {
    'primary-color': 'blue',
  },
  templateStrings: {
    pageTitle: 'My Offline Page',
  },
});

Custom offline page

import { registerFallbackPages, registerServiceWorkerController } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerFallbackPages({
  serviceWorkerController,
  pages: [{
    url: '/my-offline-page/',
    revision: '1',
  }],
});

Multiple offline pages

For most cases, a single fallback is enough. However, we support an optional refererRegex property. This can, for example, be used to render a different fallback page for users who came from a search engine:

import { registerFallbackPages, registerServiceWorkerController } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerFallbackPages({
  serviceWorkerController,
  pages: [{
    url: '/my-offline-page/',
    revision: '1',
  },
    {
      url: "/google-search-offline-page/",
      revision: "1",
      refererRegex: "https://(www.)?(google).com/",
    },
  ],
});

Fallback assets

We provide a fallback strategy for assets to use when the network is not available.

Usage

Inside your service worker:

import { registerFallbackAssets, registerServiceWorkerController } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerFallbackAssets({
  serviceWorkerController,
  assets: [
    {
      url: '/main.css',
      revision: '1',
    },
    {
      url: '/main.js',
      revision: '1',
    },
  ],
});

revision is not required, but it is highly recommended. Changing this value will cause a cache invalidation, which means we will re-cache the latest version.

Options

Pass an object with the following properties to the registerFallbackAssets function:

Content bundles

You can define a list of pages as content bundles to be cached by the service worker. These are pages that you want to be available offline.

Usage

Inside your service worker:

import { registerContentBundles, registerServiceWorkerController } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerContentBundles({
  serviceWorkerController,
  pages: [
    {
      url: '/content-bundle-1/',
      revision: '1',
    },
    {
      url: '/content-bundle-2/',
      revision: '1',
    },
  ],
});

Options

Fallback image

We provide a fallback strategy for images, it returns a fallback SVG for uncached images.

Usage

Inside your service worker:

import { registerFallbackImage, registerServiceWorkerController } from 'censorship-resilience-helpers';

const serviceWorkerController = registerServiceWorkerController();
registerFallbackImage({ serviceWorkerController });

UI components

In addition to our modules, we offer a set of UI components that come in the form of web components. While these components may offer added functionality, their primary function is to provide an alternative approach to implementing our modules without requiring any JavaScript coding.

Bookmark button

The button displays the bookmark status of the related page - whether it is currently bookmarked or not. In addition, it enables users to bookmark or unbookmark the page with just a click. Please note that this button requires the bookmarking module to function properly.

Usage

Inside your HTML:

<bookmark-button
  path="/my-page"
  bookmark-text="Bookmark"
  remove-bookmark-text="Remove Bookmark"
>
</bookmark-button>

Attributes

Pass the following attributes to the bookmark-button component:

Styling

Use the following selector:

bookmark-button::part(button) {
  background-color: rebeccapurple;
  color: white;
}

Traffic light

The component displays the user's network status - it can either be online or offline.

Usage

Inside your HTML:

<traffic-light
  href="/offline/"
  online-text="You are online."
  offline-text="You are offline."
>
</traffic-light>

Attributes

Pass the following attributes to the traffic-light component:

Styling

Use the following selectors:

traffic-light::part(button) {
  /* General button selector. */
}

traffic-light::part(online) {
  /* Online button selector. */
}

traffic-light::part(offline) {
  /* Offline button selector. */
}