Crypto Like

Crypto Like

1637234880

What is Trusted Node (TNODE) | What is TNODE token

In this article, we'll discuss information about the Trusted Node project and TNODE token. What is Trusted Node (TNODE) | What is TNODE token?

Proof-of-Stake (PoS) blockchains are on the rise, offering higher scalability and minimal environmental impact in comparison to Proof-of-Work (PoW) protocols. For users, the allure of PoS lies in the promise of passive income from staking native tokens. Many also find the ability to vote and participate in the project's future rewarding. However, the variety of protocols and requirements for staking and governance can be daunting even for seasoned crypto investors. Additionally, many DeFi protocols offer better incentives than PoS rewards, taking capital and securing power away from PoS networks.

Trusted Node builds a range of incentives and state-of-the-art UX to facilitate staking and voting and improve global PoS security. The platform offers users intuitive, multichain access to native (D)PoS protocols. It allows anyone to directly participate in a wide range of PoS protocols without personally running validator nodes. It also increases staking incentives through a variety of yield multipliers inspired by DeFi solutions. Finally, it unlocks staking liquidity, enabling both PoS and DeFi staking and allowing for capital flow between protocols rather than competition.

Trusted Node DAO represents different trusted validators that can be staked by the Trusted Node user base in exchange for automated rewards and access to PoS governance. Thus it can improve the physical and economic resilience of the global PoS network by:

1. Increasing the number of nodes,

2. Diversifying validators,

3. Increasing the amount of staked coins and the cost of PoS attacks.

Unlike similar services, Trusted Node staking is decentralized, non-custodial, and run by a Trusted Node DAO.

Executive Summary

Trusted Node is a decentralized, non-custodial validator service and governance hub enabling users to participate in PoS blockchain rewards and governance without the need to personally operate the validator nodes. Trusted Node DAO and its partners own and operate an array of validator nodes. Users have the ability to delegate coins to their chosen PoS networks, and rewards are subsequently distributed back to them. Depending on the platform’s feature utilized, rewards will be paid in blockchains’ native token, liquid derivatives, or Trusted Node token (TNODE).

Trusted Node utilizes the concept of liquid staking to promote staking and bring capital back to PoS. Users staking their coins can create liquid, synthetic tokens, i.e. representations of their locked coins, which they can then hold, trade, sell, or deposit into Trusted Node vaults or DeFi protocols. Liquid staking enables users to gain dual rewards from securing the PoS networks AND providing liquidity to high-APY vaults.

Unlike PoS staking pools and staking services, Trusted Node is decentralized, non-custodial, and governed by Trusted Node DAO. It gives users complete ownership and control of their assets. The platform also focuses on promoting DAO and user participation in the PoS governance through state-of-the-art UX.

Our mission is to improve the safety, usability, and resilience of the PoS ecosystems and enable all users to directly participate in staking rewards and decentralized governance.

How it Works

Stake native assets to PoS nodes. Restake liquid tokens to the vaults. Join multichain governance through the DAO. Enjoy your double rewards and voting power.

Tokenomics

$TNODE token is a governance token built on the Ethereum network using an ERC-20 standard. It is also the lifeblood of the Trusted Node network, providing a means of exchange between native assets and derivatives and the necessary liquidity across all vaults.

The $TNODE tokenomics model includes a 5-year vesting schedule and was designed to create a self-sustaining operation by the conclusion of the vesting period.

After the first 60 months, $TNODE will reach its maximum circulating supply, by which time the network reliance on the fee model should be established. At that time, a portion of the overall supply should be deposited into the DAO escrow for governance, and the rest used to provide dynamic liquidity to assets across the platform.

The usage of $TNODE tokens will be tied to the increase in functionality offered by the platform. As a governance token, $TNODE is also effectively collateralized by the power of the DAO-owned validators, the DAO treasury, and the underlying PoS staking rewards, continuously adding Total Value Locked (TVL) to the network.

Depositing $TNODE into the DAO escrow has many added benefits for users. However, they cannot use the same tokens to provide liquidity to the vaults. Users are, therefore, incentivized to deposit only the minimal necessary tokens into DAO and/or find the best ratio of DAO vs. Vault deposits to obtain a maximal yield boost for the Vaults.

Token Supply and Allocation

A capped total of 1 billion $TNODE tokens will be generated at the token launch. The majority of tokens will be locked and gradually released over a 5-year vesting period.

Token allocations and emissions have been designed to stimulate the Trusted Node infrastructure in the first 60 months of growth. Initially, only 6% of tokens will be released into circulation, with only the public sale allocation fully distributed at launch. 12% of the total token supply is allocated to private and public sale (IDO). A further 10% will be vested and distributed over the course of 4 years as bounties to the Trusted Node partners, auditors, advisors, and marketing influencers. Another 10% will finance ongoing product development.

Trusted Node team members will receive a total of 15% of the token supply. After the 12-month vesting period, linear vesting will apply, with approximately 4% of tokens released per month for 24 months.

53% of the total $TNODE supply will initially be held in Gnosis Safe and ultimately transferred into smart contracts to be released over the span of 5-years as liquidity vault rewards (43%) and staking rewards (10%).

How and Where to Buy TNODE token?

 TNODE token is now live on the Binance mainnet. The token address for TNODE is 0x7f12a37b6921ffac11fab16338b3ae67ee0c462b. Be cautious not to purchase any other token with a smart contract different from this one (as this can be easily faked). We strongly advise to be vigilant and stay safe throughout the launch. Don’t let the excitement get the best of you.

Just be sure you have enough BNB in your wallet to cover the transaction fees.

Join To Get BNB (Binance Coin)! ☞ CLICK HERE

You will have to first buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…

We will use Binance Exchange here as it is one of the largest crypto exchanges that accept fiat deposits.

Once you finished the KYC process. You will be asked to add a payment method. Here you can either choose to provide a credit/debit card or use a bank transfer, and buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…

☞ SIGN UP ON BINANCE

Step by Step Guide : What is Binance | How to Create an account on Binance (Updated 2021)

Next step

You need a wallet address to Connect to Pancakeswap Decentralized Exchange, we use Metamask wallet

If you don’t have a Metamask wallet, read this article and follow the steps ☞ What is Metamask wallet | How to Create a wallet and Use

Transfer $BNB to your new Metamask wallet from Binance wallet

Next step

Connect Metamask Wallet to Pancakeswap Decentralized Exchange and Buy, Swap TNODE token

Contract: 0x7f12a37b6921ffac11fab16338b3ae67ee0c462b

Read more: What is Pancakeswap | Beginner’s Guide on How to Use Pancakeswap

The top exchange for trading in TNODE token is currently: PancakeSwap (V2)

Top exchanges for token-coin trading. Follow instructions and make unlimited money

BinanceBittrexPoloniexBitfinexHuobiMXCProBITGate.ioCoinbase

🔺DISCLAIMER: The Information in the post isn’t financial advice, is intended FOR GENERAL INFORMATION PURPOSES ONLY. Trading Cryptocurrency is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money.

🔥 If you’re a beginner. I believe the article below will be useful to you ☞ What You Should Know Before Investing in Cryptocurrency - For Beginner

⭐ ⭐ ⭐The project is of interest to the community ☞ **-----https://geekcash.org-----**⭐ ⭐ ⭐

Find more information TNODE token ☞ Website 

I hope this post will help you. Don't forget to leave a like, comment and sharing it with others. Thank you!

#bitcoin #cryptocurrency

What is GEEK

Buddha Community

What is Trusted Node (TNODE) | What is TNODE token
Angelina roda

Angelina roda

1624579440

How to Buy BonFire Token on Trust Wallet: QUICK & EASY CRYPTO TUTORIAL! DO NOT MISS!!!

In this video, we walk-through how to buy BonFire Token on Trust Wallet in just a few, simple steps. You can purchase BonFire crypto from anywhere in the world using the Trust: Crypto & Bitcoin Wallet and PancakeSwap DEX. Learn how to purchase the BonFire cryptocurrency!
What is BonFire?

Bonfire is a community orientated, frictionless, yield generating contract based on the Binance Smart Chain. The project is based on an RFI tokenomic model that takes a 5% fee on every transaction that is proportionally redistributed to all holders of the Bonfire token, and another 5% fee that goes into the liquidity pool to provide additional security for token holders.

The project maintains the long-term goal of launching a decentralized social media platform, providing a space for NFT sales and sharing, as well as other utilities and sub-projects that are yet to be announced. The strongest asset of Bonfire is the incredible community that has been built around it. Giveaways, competitions and charity donations are an integral part of Bonfire.

BonFire Wallet Address (copy & paste into PancakeSwap): 0x5e90253fbae4dab78aa351f4e6fed08a64ab5590

What is the Trust: Crypto & Bitcoin Wallet?

The best and quickest way to buy the BonFire crypto is through the Trust wallet. The Trust Wallet is a decentralized wallet, that has access to Decentralized Applications – or DApps for short. Its main goal is to make crypto more accessible with an intuitive and easy to understand user interface.

What is PancakeSwap?

PancakeSwap is a Binance Smart Chain-based Decentralized Exchange – or DEX for short - launched by some anonymous developers with a penchant for breakfast food. The great thing about using PancakeSwap is the extremely low fees and all the amazing features and functionality it offers.

I hope you found this video useful and I’d love to hear your thoughts and experiences with BonFire! I’m extremely active in my comments and if you have any questions I am always happy to answer them. Best of luck to all of you and thanks for watching!

📺 The video in this post was made by Will Walker
The origin of the article: https://www.youtube.com/watch?v=0h5QC-h1TKo
🔺 DISCLAIMER: The article is for information sharing. The content of this video is solely the opinions of the speaker who is not a licensed financial advisor or registered investment advisor. Not investment advice or legal advice.
Cryptocurrency trading is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money
🔥 If you’re a beginner. I believe the article below will be useful to you ☞ What You Should Know Before Investing in Cryptocurrency - For Beginner
⭐ ⭐ ⭐The project is of interest to the community. Join to Get free ‘GEEK coin’ (GEEKCASH coin)!
☞ **-----CLICK HERE-----**⭐ ⭐ ⭐
Thanks for visiting and watching! Please don’t forget to leave a like, comment and share!

#bitcoin #blockchain #bonfire token #trust wallet #how to buy bonfire token on trust wallet #how to buy bonfire token on trust wallet: quick & easy crypto tutorial!

Angelina roda

Angelina roda

1624637040

How to Buy Save Planet Earth Token on Trust Wallet: Quick & Easy Crypto Tutorial!

In this video, we walk-through how to buy Save Planet Earth crypto on the Trust Wallet in just a few, simple steps. You can purchase the Save Planet Earth token from anywhere in the world using the Trust: Crypto & Bitcoin Wallet and PancakeSwap DEX. The Save Planet Earth ($SPE) coin has exploded in popularity, but it can be confusing at first knowing where to buy the cryptocurrency. So, let’s get started!
What is the Save Planet Earth token?

Save Planet Earth is a worldwide program to sequester carbon through accelerated afforestation and reforestation initiatives with the mission of removing the excess carbon in the atmosphere, thus lessening the impacts of global warming that has now risen to perilous levels, with the aid of a newly built up (tree-based) carbon store.

Save Planet Earth Wallet Address (copy & paste into PancakeSwap): 0xdbaaa36b347d56b77ce0e36f050fceebbf9fbc38

What is the Trust: Crypto & Bitcoin Wallet?

The best and quickest way to buy the Save Planet Earth crypto is through the Trust wallet. The Trust Wallet is a decentralized wallet, that has access to Decentralized Applications – or DApps for short. Its main goal is to make crypto more accessible with an intuitive and easy to understand user interface.

What is PancakeSwap?

PancakeSwap is a Binance Smart Chain-based Decentralized Exchange – or DEX for short - launched by some anonymous developers with a penchant for breakfast food. The great thing about using PancakeSwap is the extremely low fees and all the amazing features and functionality it offers.

I hope you found this video useful and I’d love to hear your thoughts and experiences with Save Planet Earth! I’m extremely active in my comments and if you have any questions I am always happy to answer them. Best of luck to all of you and thanks for watching!

📺 The video in this post was made by Will Walker
The origin of the article: https://www.youtube.com/watch?v=Sn-JoXxSF34
🔺 DISCLAIMER: The article is for information sharing. The content of this video is solely the opinions of the speaker who is not a licensed financial advisor or registered investment advisor. Not investment advice or legal advice.
Cryptocurrency trading is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money
🔥 If you’re a beginner. I believe the article below will be useful to you ☞ What You Should Know Before Investing in Cryptocurrency - For Beginner
⭐ ⭐ ⭐The project is of interest to the community. Join to Get free ‘GEEK coin’ (GEEKCASH coin)!
☞ **-----CLICK HERE-----**⭐ ⭐ ⭐
Thanks for visiting and watching! Please don’t forget to leave a like, comment and share!

#bitcoin #blockchain #save planet earth token #trust wallet #how to buy save planet earth token on trust wallet #how to buy save planet earth token on trust wallet: quick & easy crypto tutorial!

Hire Dedicated Node.js Developers - Hire Node.js Developers

If you look at the backend technology used by today’s most popular apps there is one thing you would find common among them and that is the use of NodeJS Framework. Yes, the NodeJS framework is that effective and successful.

If you wish to have a strong backend for efficient app performance then have NodeJS at the backend.

WebClues Infotech offers different levels of experienced and expert professionals for your app development needs. So hire a dedicated NodeJS developer from WebClues Infotech with your experience requirement and expertise.

So what are you waiting for? Get your app developed with strong performance parameters from WebClues Infotech

For inquiry click here: https://www.webcluesinfotech.com/hire-nodejs-developer/

Book Free Interview: https://bit.ly/3dDShFg

#hire dedicated node.js developers #hire node.js developers #hire top dedicated node.js developers #hire node.js developers in usa & india #hire node js development company #hire the best node.js developers & programmers

Royce  Reinger

Royce Reinger

1658068560

WordsCounted: A Ruby Natural Language Processor

WordsCounted

We are all in the gutter, but some of us are looking at the stars.

-- Oscar Wilde

WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.

Features

  • Out of the box, get the following data from any string or readable file, or URL:
    • Token count and unique token count
    • Token densities, frequencies, and lengths
    • Char count and average chars per token
    • The longest tokens and their lengths
    • The most frequent tokens and their frequencies.
  • A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
  • Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as ["Bayrūt"] and not ["Bayr", "ū", "t"], for example.
  • Opens and reads files. Pass in a file path or a url instead of a string.

Installation

Add this line to your application's Gemfile:

gem 'words_counted'

And then execute:

$ bundle

Or install it yourself as:

$ gem install words_counted

Usage

Pass in a string or a file path, and an optional filter and/or regexp.

counter = WordsCounted.count(
  "We are all in the gutter, but some of us are looking at the stars."
)

# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")

.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.

API

WordsCounted

WordsCounted.count(input, options = {})

Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.count("Hello Beirut!")

Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.

WordsCounted.from_file(path, options = {})

Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.from_file("hello_beirut.txt")

Accepts the same options as .count.

Tokeniser

The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.

Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.

#tokenise([pattern: TOKEN_REGEXP, exclude: nil])

tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise

# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")

# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)

See Excluding tokens from the analyser and Passing in a custom regexp for more information.

Counter

The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.

#token_count

Returns the token count of a given string.

counter.token_count #=> 15

#token_frequency

Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.

counter.token_frequency

[
  ["the", 2],
  ["are", 2],
  ["we",  1],
  # ...
  ["all", 1]
]

#most_frequent_tokens

Returns a hash where each key-value pair is a token and its frequency.

counter.most_frequent_tokens

{ "are" => 2, "the" => 2 }

#token_lengths

Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.

counter.token_lengths

[
  ["looking", 7],
  ["gutter",  6],
  ["stars",   5],
  # ...
  ["in",      2]
]

#longest_tokens

Returns a hash where each key-value pair is a token and its length.

counter.longest_tokens

{ "looking" => 7 }

#token_density([ precision: 2 ])

Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.

counter.token_density

[
  ["are",     0.13],
  ["the",     0.13],
  ["but",     0.07 ],
  # ...
  ["we",      0.07 ]
]

#char_count

Returns the char count of tokens.

counter.char_count #=> 76

#average_chars_per_token([ precision: 2 ])

Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.

counter.average_chars_per_token #=> 4

#uniq_token_count

Returns the number of unique tokens.

counter.uniq_token_count #=> 13

Excluding tokens from the tokeniser

You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.

  1. A space-delimited string. The filter will normalise the string.
  2. A regular expression.
  3. A lambda.
  4. A symbol that names a predicate method. For example :odd?.
  5. An array of any combination of the above.
tokeniser =
  WordsCounted::Tokeniser.new(
    "Magnificent! That was magnificent, Trevor."
  )

# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]

# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]

# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]

# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]

# Using an array
tokeniser = WordsCounted::Tokeniser.new(
  "Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
  exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]

Passing in a custom regexp

The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.

/[\p{Alpha}\-']+/

You can pass your own criteria as a Ruby regular expression to split your string as desired.

For example, if you wanted to include numbers, you can override the regular expression:

counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]

Opening and reading files

Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.

counter = WordsCounted.from_file("url/or/path/to/file.text")

Gotchas

A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.

counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency

[
  ["do",   2],
  ["how",  1],
  ["you",  1],
  ["-you", 1], # WTF, mate!
  ["are",  1],
  # ...
]

In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.

A note on case sensitivity

The program will normalise (downcase) all incoming strings for consistency and filters.

Roadmap

Ability to open URLs

def self.from_url
  # open url and send string here after removing html
end

Are you using WordsCounted to do something interesting? Please tell me about it.

Gem Version 

RubyDoc documentation.

Demo

Visit this website for one example of what you can do with WordsCounted.


Contributors

See contributors.

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request

Author: Abitdodgy
Source Code: https://github.com/abitdodgy/words_counted 
License: MIT license

#ruby #nlp 

Words Counted: A Ruby Natural Language Processor.

WordsCounted

We are all in the gutter, but some of us are looking at the stars.

-- Oscar Wilde

WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.

Are you using WordsCounted to do something interesting? Please tell me about it.

 

Demo

Visit this website for one example of what you can do with WordsCounted.

Features

  • Out of the box, get the following data from any string or readable file, or URL:
    • Token count and unique token count
    • Token densities, frequencies, and lengths
    • Char count and average chars per token
    • The longest tokens and their lengths
    • The most frequent tokens and their frequencies.
  • A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
  • Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as ["Bayrūt"] and not ["Bayr", "ū", "t"], for example.
  • Opens and reads files. Pass in a file path or a url instead of a string.

Installation

Add this line to your application's Gemfile:

gem 'words_counted'

And then execute:

$ bundle

Or install it yourself as:

$ gem install words_counted

Usage

Pass in a string or a file path, and an optional filter and/or regexp.

counter = WordsCounted.count(
  "We are all in the gutter, but some of us are looking at the stars."
)

# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")

.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.

API

WordsCounted

WordsCounted.count(input, options = {})

Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.count("Hello Beirut!")

Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.

WordsCounted.from_file(path, options = {})

Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.from_file("hello_beirut.txt")

Accepts the same options as .count.

Tokeniser

The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.

Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.

#tokenise([pattern: TOKEN_REGEXP, exclude: nil])

tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise

# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")

# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)

See Excluding tokens from the analyser and Passing in a custom regexp for more information.

Counter

The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.

#token_count

Returns the token count of a given string.

counter.token_count #=> 15

#token_frequency

Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.

counter.token_frequency

[
  ["the", 2],
  ["are", 2],
  ["we",  1],
  # ...
  ["all", 1]
]

#most_frequent_tokens

Returns a hash where each key-value pair is a token and its frequency.

counter.most_frequent_tokens

{ "are" => 2, "the" => 2 }

#token_lengths

Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.

counter.token_lengths

[
  ["looking", 7],
  ["gutter",  6],
  ["stars",   5],
  # ...
  ["in",      2]
]

#longest_tokens

Returns a hash where each key-value pair is a token and its length.

counter.longest_tokens

{ "looking" => 7 }

#token_density([ precision: 2 ])

Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.

counter.token_density

[
  ["are",     0.13],
  ["the",     0.13],
  ["but",     0.07 ],
  # ...
  ["we",      0.07 ]
]

#char_count

Returns the char count of tokens.

counter.char_count #=> 76

#average_chars_per_token([ precision: 2 ])

Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.

counter.average_chars_per_token #=> 4

#uniq_token_count

Returns the number of unique tokens.

counter.uniq_token_count #=> 13

Excluding tokens from the tokeniser

You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.

  1. A space-delimited string. The filter will normalise the string.
  2. A regular expression.
  3. A lambda.
  4. A symbol that names a predicate method. For example :odd?.
  5. An array of any combination of the above.
tokeniser =
  WordsCounted::Tokeniser.new(
    "Magnificent! That was magnificent, Trevor."
  )

# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]

# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]

# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]

# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]

# Using an array
tokeniser = WordsCounted::Tokeniser.new(
  "Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
  exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]

Passing in a custom regexp

The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.

/[\p{Alpha}\-']+/

You can pass your own criteria as a Ruby regular expression to split your string as desired.

For example, if you wanted to include numbers, you can override the regular expression:

counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]

Opening and reading files

Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.

counter = WordsCounted.from_file("url/or/path/to/file.text")

Gotchas

A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.

counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency

[
  ["do",   2],
  ["how",  1],
  ["you",  1],
  ["-you", 1], # WTF, mate!
  ["are",  1],
  # ...
]

In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.

A note on case sensitivity

The program will normalise (downcase) all incoming strings for consistency and filters.

Roadmap

Ability to open URLs

def self.from_url
  # open url and send string here after removing html
end

Contributors

See contributors.

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request

Author: abitdodgy
Source code: https://github.com/abitdodgy/words_counted
License: MIT license

#ruby  #ruby-on-rails