Important: This documentation covers Yarn 1 (Classic).
For Yarn 2+ docs and migration guide, see yarnpkg.com.

Package detail

@kaufman-bot/html-scraper-server

EndyKaufman12MIT3.5.2TypeScript support: included

Html scraper commands and tools

kaufman-bot, nx, nests, telegram, html-scraper

readme

README.md

changelog

Changelog

All notable changes to this project will be documented in this file. See standard-version for commit guidelines.

3.5.2 (2022-11-29)

Bug Fixes

  • move migrations to libs, added last version of libs on generate code with schematics (34843be)

3.5.1 (2022-11-29)

Bug Fixes

  • update i18 paths in libs, added correct work with translations to schematics project (73ea9eb)

3.5.0 (2022-11-29)

Features

  • added usage locale from nestjs-translates for detect default locale, added assets to builded libs (de26c97)

3.4.0 (2022-11-28)

Features

  • added isRecursive options to processed message, add html message type (502bfa3)

3.3.0 (2022-11-22)

Features

  • add support work with multi states in one moments (5aa8e89)
  • append locale values to msg argument in onBeforeBotCommands, onMessage, onContextBotCommands, onHelp, onAfterBotCommands args, move all duplicated checkSpyWords to BotCommandsToolsService (6ea9f08)
  • core: add changeMessageId BotCommandsStorageProvider (bfa6244)

3.2.2 (2022-11-13)

Bug Fixes

  • correction of the general version of the libraries (670d11d)

3.2.1 (2022-11-13)

Bug Fixes

  • fixed errors in class names swither=>switcher (939df24)

3.2.0 (2022-11-10)

Features

  • add botMeetingInformation to main BotCommandsService (204d1e6)

3.1.2 (2022-11-10)

Bug Fixes

  • schematics: add all need deps for basic bot (5912394)

3.1.1 (2022-11-10)

Bug Fixes

  • schematics: update deps (79df8fd)

3.1.0 (2022-11-10)

Features

  • deps: update nx to 15.0.13, update nest to 9.2.0 (ddd615b)

3.0.0 (2022-11-10)

⚠ BREAKING CHANGES

Features

Bug Fixes

  • short-commands: update render state (5ed6e61)

2.10.1 (2022-11-05)

Bug Fixes

  • schematics: update app template (312c21f)

2.10.0 (2022-11-05)

Features

  • bot-in-groups: add defaultGroupGlobalContext and defaultGlobalContext, remove usage imports from this commands in bot-in-groups (97abcc7)

2.9.1 (2022-11-05)

Bug Fixes

  • remove create duplicated envs (cbcb5fa)

2.9.0 (2022-11-05)

Features

  • update deps, change symbols token types to strings (b94c906)

2.8.0 (2022-11-05)

Features

  • add support collect phone number from input (047fb3a)
  • add use prisma as storage for BOT_COMMANDS_STORAGE, add support send message about new taxi order to admins (f98459c)
  • demo-taxi-orders: add support use contacts for detect contact phone (c104aba)
  • extract all logic into different services (70ea8fc)
  • remove all not needed codes (8fe3cfe)
  • rename botCommandHandlerId to handlerId, botGlobalContext to globalContext, botCommandHandlerBreak to handlerStop, isStart to start (4cd0f2b)
  • start add demo-taxi-orders (#77) (ab678d6)

Bug Fixes

  • update for correct wor k context and other commands (8c26130)
  • update for correct work getStateByUsedMessageId (fa96678)

2.7.2 (2022-09-05)

2.7.1 (2022-09-05)

2.7.0 (2022-09-03)

Features

  • first-meeting: move all logic to standalone classes (cce00cd)

Bug Fixes

  • schematics: add process exit on SIGTERM (ac41368)

2.6.0 (2022-04-29)

Features

  • add support use inlineKeyboard in Telegram bot on NestJS (b6ff692)

2.5.1 (2022-04-28)

Bug Fixes

  • update for correct work meeting commands (2f7730b)

2.5.0 (2022-04-24)

Features

  • add disableBotInfo options to BotCommandsConfig (e51288d)

Bug Fixes

  • schematics: add custom npm scripts and update version of rucken (886f61e)

2.4.0 (2022-04-22)

Features

  • append store dependencies in build libs (898eb45)

2.3.3 (2022-04-22)

Bug Fixes

  • set default versions for kaufman bot to * (72bde2d)

2.3.2 (2022-04-22)

Bug Fixes

2.3.1 (2022-04-22)

Bug Fixes

2.3.0 (2022-04-22)

Features

  • add schematics for create empty kaufman-bot applications and library in Telegram bot on NestJS (8572135)

Bug Fixes

2.3.0 (2022-04-22)

Features

  • add schematics for create empty kaufman-bot applications and library in Telegram bot on NestJS (8572135)

Bug Fixes

2.2.2 (2022-04-17)

Bug Fixes

2.2.1 (2022-04-17)

Bug Fixes

2.2.0 (2022-04-17)

Features

  • publish all the libraries in Telegram bot on NestJS to the npm registry (23b7fe2)

2.1.0 (2022-04-16)

Features

  • refactoring monolith application to modules with DI in Telegram bot on NestJS (#80) (a50a1be)

Bug Fixes

  • add source-map-support for look errors in typescript files (e648c66)
  • terminate process if message not detected (e923248)
  • update for correct work with empty message in context (9674b90)

2.0.0 (2022-04-13)

⚠ BREAKING CHANGES

  • rewrite all project

Features

  • create release of KaufmanBot v 2.0.0 [ci skip] (062fdc1)
  • rewrite all project (2bfcb85)

1.4.0 (2022-04-13)

Features

  • add a module for debugging messages in admin mode and user mode for Telegram bot on NestJS (719e56c)
  • add a module for process unhandled message in NestJS Telegram bot with Google Dialogflow API (4e7d0a3)
  • add comment for vercel deploy (6276685)
  • add deploy ci config for production (03a12b8)
  • add deploy nestjs application to heroku (4d78df7)
  • add deploy nestjs application to vercel (e1d4f5f)
  • add dev and prod infrastructure on docker compose for NestJS application (6f6de08)
  • add dictionaries for translates (6c7879b)
  • add different multilingual settings for FactsGeneratorModule in NestJS Telegram bot (3178fd8)
  • add env-var, lint-staged and etc. for nx workspace (1abedc7)
  • add facts generator (4cae188)
  • add micromatch (db29683)
  • add multi-language support for telegram bot on NestJS (641320a)
  • add nestjs nx plugin, create server app and core lib (f07f657)
  • add postgres to docker compose and dokku infrastructure for telegram bot in NestJS (173488e)
  • add Prisma ORM to KaufmanBot (NestJS telegram bot application) (330bfbb)
  • add support BotCommandsService from outside of project (043d3db)
  • add support telegram bot to nestjs with nestjs-telegraf (09a418d)
  • add support work in groups and use global bot name for that in Telegram bot on NestJS (310090a)
  • add suppot show aliases in help message (bb4e46d)
  • add vercel config (7f22e72)
  • append "botinfo" command for look deploy, server and user information in Telegram bot on NestJS (8919089)
  • append a support to work telegram bot over web hook for speed up create answer to user in Telegram bot on NestJS (d05a60f)
  • create a database for the application and create first migration via flyway (e533abf)
  • create a database in dokku infra and set up run flyway migration from github runner (916364c)
  • create CurrencyConverterModule for telegram bot on NestJS using ScraperModule (90c65a4)
  • create example of recursive contextable commands "first meeting" with store data in database for Telegram bot on NestJS (2e718d6)
  • create module for generate random jokes in Telegram bot on NestJS (c569f4c)
  • create module for generate random quote of famus people in Telegram bot on NestJS (fb14e3b)
  • create scraper plugin for telegram bot on nestjs (e7a7111)
  • create short commands and example using recursive contextable work in Telegram bot on NestJS (e839194)
  • Deploy to netfly (6f98f81)
  • handling nodejs errors (823dc32)
  • hide system commands from users and add bot description to Telegram bot on NestJS (886bcb9)
  • move helper functions to bot commands, disable dialog flow commands for groups (f5c73bd)
  • move the bot name to config of first meeting module, and set it from tha app module (c9083a8)
  • remove all code, and create new empty nx project (c6651b9)
  • remove have admin access for spy users commands (b0ff1bb)
  • remove logic for onBeforeBotCommands in FirstMeeting (7784d9b)
  • update steps, add failure status to netfly deploy (55eefff)
  • use nestjs-custom-injector to create dynamic handlers in NestJS when creating a telegram bot (8a51446)

Bug Fixes

  • add check result of scraping before trim only currency (4c95e55)
  • add class transform to deps (fed0469)
  • add support short codes in groups mode (b8b3263)
  • add support spy "bot info", remove override from id (6e563db)
  • add trycatch for errors (2d9df04)
  • disable help message for botinfo and update steps (5b0880f)
  • error: 409: Conflict: terminated by other getUpdates request (20de47a)
  • refactor get locale (228aee7)
  • remove global prefix (f4f9695)
  • set msg optionals in LanguageSwitherService, update steps [ci skip] (0a26e99)
  • updaet language switcher for correct work with groups (549709f)
  • update for correct processing set command (5ae6c1f)
  • update for correct work with command "bot info" (60d0865)
  • update main.ts for correct work with webhooks (0264824)
  • update null errors (b683c48)

1.4.0-alpha.13 (2021-04-29)

Bug Fixes

  • revert ingress to networking.k8s.io/v1beta1 (e04f9a0)

1.4.0-alpha.12 (2021-04-28)

Features

  • update ingress config for networking.k8s.io/v1 (10de543)
  • update issuer script (3043120)
  • k8s: update limits of resources (73d20b8)

Bug Fixes

  • add generate scripts in deploy with ignore cache of node modules (a158635)
  • add remove exists file on local build images (1895d71)
  • add support deploy from develop branch (a98c0be)

1.4.0-alpha.11 (2021-01-18)

Bug Fixes

  • ci: add run scripts:build on github actions (52920e3)
  • test: enable google apis test (9ce10de)

1.4.0-alpha.10 (2021-01-18)

Bug Fixes

  • add use port from github envs (38bc253)

1.4.0-alpha.9 (2021-01-18)

Bug Fixes

  • ci: add use PORT env in k8s (2836bf1)

1.4.0-alpha.8 (2021-01-18)

Bug Fixes

  • ci: update import-images (1321f08)

1.4.0-alpha.7 (2021-01-18)

Bug Fixes

  • ci: add support update docker image versions for k8s (8ab3a04)

1.4.0-alpha.6 (2021-01-18)

Bug Fixes

  • add use github envs in deploy action (de32538)

1.4.0-alpha.5 (2021-01-18)

Features

1.4.0-alpha.4 (2021-01-18)

Bug Fixes

  • update generate command for github actions (c8d6fb8)

1.4.0-alpha.3 (2021-01-18)

Bug Fixes

  • ci: remove not need files from docker (524d8b4)
  • ci: update deploy stage, add envs for docker tests (a44b9e9)

1.4.0-alpha.2 (2021-01-18)

Bug Fixes

  • ci: update deploy-stage action (a5a98e4)

1.4.0-alpha.1 (2021-01-18)

1.4.0-alpha.0 (2021-01-18)

Features

  • api-ai: Update for multi language agents (0f1d0ee)
  • base.bot: Add method for get correct env value (7e05884)
  • ci: add support run in docker and k8s (2de7ff6)
  • debug: Add remote debug, for fix microsoft bot error :( (11e6596)
  • plugin: Add GoogleApisBotPlugin for use google custom search api (22e3f37)
  • plugin: Add plugin for get informations from wikipedia (2e64581)
  • plugin-scraper: add scraper plugin and use it for add online ping (1aad329)
  • plugins: Add plugins for "quote" (76b7470)
  • Add answer for question to bot "what you can do?" (60d2030)
  • Add plugin for scrapping jokes from http://bash.im (62901ba)
  • Add support work with skype (fb50fe0)
  • Start add microsoft bot system (6842f0f)
  • ts: Move source code to typescript (c2cfe08)

Bug Fixes

  • Try fix wiki answer (8efb9f8)
  • Try fix wiki answer #2 (26f664c)
  • update deps (370fab6)
  • update deps (8643ad1)
  • update SCRAPER_BASHORG (3066635)
  • deps: Update dependencies and change source for correct work (65e1157)
  • errors: Fix small errors (590ed8e)
  • scraper.plugin: Support set custom codepage for sites (0f804d3)
  • scripts: Add app.json for run pre-deploy script (b0e2baa)
  • scripts: Change global tsc run to local (8092266)
  • scripts: Install typescript as global (ef5de72)
  • scripts: Update pre-deploy script #1 (daa17ee)
  • scripts: Update pre-deploy script #2 (d454dd4)
  • scripts: Update pre-deploy script #3 (49b2399)
  • scripts: Update pre-deploy script #4 (7c75256)
  • scripts: Update pre-deploy script #5 (0782e2e)
  • scripts: Update pre-deploy script #6 (5fe00c9)
  • scripts: Update pre-deploy script #7 (d65f233)
  • scripts: Update start script (050d805)
  • Add correct new line for microsoft bot (f896c75)
  • Add delay on run plugins (7559d56)
  • Add dellay on microsoft sendMessage (9c85918)
  • Add iconv-lite for correct decode russian messages (a45fa2c)
  • Bad fix error on use incorrect node-telegram-bot-api: index.d.ts (b01edc7)
  • Change env default values (d088c84)
  • Error in include rollbar to web server (e131208)
  • Error max length on request to api.ai (8bf1748)
  • Error on debug microsoft message (6a6e385)
  • Error unescape on send messages (70ab246)
  • errors on private chat with bot name (ebffa8c)
  • Remote debug for admin, add in plugins work with only text messages (5b6b064)
  • Remove quotes from message (a9e06e0)
  • Small error on debug microsoft bot (bc06217)
  • Test scraper plugin (e1e149a)
  • Try fix bug on microsoft bot #1 (03a5437)
  • Try fix bug on microsoft bot #10 (1a7ab17)
  • Try fix bug on microsoft bot #11 (7bf4204)
  • Try fix bug on microsoft bot #12 (5878876)
  • Try fix bug on microsoft bot #13 (292f31c)
  • Try fix bug on microsoft bot #14 (862dcf1)
  • Try fix bug on microsoft bot #15 (428e1f5)
  • Try fix bug on microsoft bot #16 (4164660)
  • Try fix bug on microsoft bot #17 (f67a880)
  • Try fix bug on microsoft bot #18 (36c7ea9)
  • Try fix bug on microsoft bot #19 (9a27373)
  • Try fix bug on microsoft bot #2 (c1f97b2)
  • Try fix bug on microsoft bot #3 (3da1aa0)
  • Try fix bug on microsoft bot #4 (b4e4baf)
  • Try fix bug on microsoft bot #5 (2d3699a)
  • Try fix bug on microsoft bot #6 (3ac965c)
  • Try fix bug on microsoft bot #8 (45203ec)
  • Try fix bug on microsoft bot #9 (728e039)
  • Try fix error run scraper test on travis (b1f8437)
  • Try fix error run scraper test on travis #2 (79a9276)
  • Try fix error run scraper test on travis #2 (47324b6)
  • Update plugin names and fix detect message author language (9162444)
  • Update symbol for quoted text on microsoft bot (7fba81f)
  • wiki: Add load en version of page if not found for bot locale, refactoring source on work with words (b276cfd)
  • wiki.plugin: Add make answer for many founded response (ccd8a2b)
  • wrong work in private mode (3903b52)
  • wiki: Fix error on first search (bbb7a61)

1.3.1 (2018-01-13)

Bug Fixes

  • errors: Fix small errors (590ed8e)

1.3.0 (2017-10-29)

Bug Fixes

  • scripts: Add app.json for run pre-deploy script (b0e2baa)
  • scripts: Change global tsc run to local (8092266)
  • scripts: Install typescript as global (ef5de72)
  • scripts: Update pre-deploy script #1 (daa17ee)
  • scripts: Update pre-deploy script #2 (d454dd4)
  • scripts: Update pre-deploy script #3 (49b2399)
  • scripts: Update pre-deploy script #4 (7c75256)
  • scripts: Update pre-deploy script #5 (0782e2e)
  • scripts: Update pre-deploy script #6 (5fe00c9)
  • scripts: Update pre-deploy script #7 (d65f233)

Features

  • plugin: Add GoogleApisBotPlugin for use google custom search api (22e3f37)

1.2.1 (2017-10-23)

Bug Fixes

  • scripts: Update start script (050d805)

1.2.0 (2017-10-23)

Bug Fixes

  • Small error on debug microsoft bot (bc06217)

Features

  • api-ai: Update for multi language agents (0f1d0ee)

1.0.1 (2017-08-19)

Update dependencies

1.0.0 (2017-08-19)

First release