What is Pine Protocol (PINE) | What is PINE token

In this article, we'll discuss information about the Pine Protocol project and PINE token. What is Pine Protocol (PINE) | What is PINE token?

Pine protocol is a two-sided decentralized non-custodial protocol that facilitates asset-backed loan transactions between lenders and borrowers. Lenders set up their own lending pools, choose NFT collections that they are willing to lend against and set their own terms for loan offers. These offers are then added to a one-sided offer book. Borrowers can choose from these offers and borrow digital currencies against them using their NFT assets as collateral.

Our Mission

Our mission at Pine is to build and facilitate the adoption of technology that will bring asset-backed financing on-chain.

As true believers in blockchain technology, we see a future where payment will be done in digital currencies and asset ownership will be represented by non fungible digital tokens (“NFT”). Our solution, the Pine Protocol, will be the smart contract infrastructure that will allow asset-back financing to be conducted more efficiently and transparently on the blockchains.

Our technology solutions will initially be built to cater to the early adopters of digital assets financial services, i.e. NFTfi, and be eventually extended to a wider set of traditional assets with adoption from traditional financial institutions.

The Pine team is composed of contributors with extensive experience and expertise in blockchain technology, digital assets exchange, quantitative trading, software development, e-commerce and traditional banking.

Our Solutions

Pine Protocol - non-custodial decentralized asset-backed lending protocol that allows borrowers to borrow fungible digital tokens from lenders using non-fungible tokens as collateral
Pine Platform - two-sided loan marketplace decentralized application that is essentially an interface for lenders and borrowers to interact with the Pine Protocol

Why Pine?

No Protocol Insolvency: Every lender sets up their own segregated lending pool on the Pine protocol instead of participating in commingled lending pools alongside with multiple depositors. This gives each lender flexibility to choose the types of collateral they would like to lend against and set their own terms.
Peace of Mind: All loans are structured as term loans on the Pine Protocol. The structure makes it a lot easier for borrowers to manage their loan positions as everything, such as repayment date, total interest payable, etc are known and agreed upon on the onset when the loan is initiated. Under normal circumstances, borrowers face no liquidation risk as long as they repay or extend the loans before the end of the loan term.

For Lenders

Earn yield on fungible digital assets
Acquire NFT assets at a discount
Segregated pool structure for better market and compliance risk management

For Borrowers

Instant permissionless loan with no back-and-forth needed with lenders
Multiple lenders to choose from to ensure competitive terms
Fixed term loans giving borrower peace of mind to not get liquidated easily
Flexibility to repay loan early or to extend loan via rollover
Mortgage-like features giving flexibility for buying and selling NFTs

Elements that make our protocol stand out

1. Asset-Backed Loan

The main product of the protocol is to serve as a facilitating platform for Asset Back Loan borrowing and underwriting. Users will be able to pledge NFTs as collateral to meet their liquidity requirements while on the other hand to extract extra yield from their idle cryptocurrency cash.

2. Segregated Pool

Every lender sets up their own segregated lending pool on the Pine protocol instead of participating in commingled lending pools alongside with multiple depositors. This gives each lender flexibility to choose the types of collateral they would like to lend against and set their own terms. When a loan position defaults, the ownership of the collateral is transferred to the lender. There is no need for forced selling of the collateral as every loan and the underlying collateral is mapped to only one lender. Finally, lenders face less compliance and regulatory risk with the segregated pool structure as compared to a public lending pool where funds from multiple depositors are commingled.

Text	Segregated Pool	Commingled Pool
Risk Assessment	Accurate	Blurry
Control of Exposure	Lender	Protocol
Ownership of Collateral	Defined	Vague
Risk of Bank Run	Not at risk	At Risk

3. Term Loan

All loans are structured as term loans on the Pine Protocol. This means that all loans on Pine have a fixed duration, e.g. 7 days. Lenders can offer multiple loan durations when setting up a lending pool for a specific NFT collection. Furthermore, lenders can also set different terms, i.e. LTV and interest rates, for different loan durations in order to manage the associated risk. The term loan structure makes it a lot easier for borrowers to manage their loan positions as everything, such as repayment date, total interest payable, etc are known and agreed upon on the onset when the loan is initiated. Under normal circumstances, borrowers face no liquidation risk as long as they repay or extend the loans before the end of the loan term.

Text	Term Loans	Continuous Loans
Terms of Loan (e.g. interest payable)	Fixed at the start of term	Changes constantly
Interest Rate	Fixed	Volatile
Cash Flows	Predictable	Unpredictable
Market-to-market Liquidation	No	Yes
Risk of Protocol Insolvency	Low	High

Feature

Loan Marketplace: The Pine platform (pine.loans) serves as a marketplace decentralized application (“dApp”) for asset-backed loans. It is a platform for multiple lenders to list their loan offerings and allows NFT holders to initiate and extend loans with the best terms available on the market. In the back, the platform operates similar to an exchange that provides an offer book structure and guarantees enforceability of the terms.
Lender Portal: The Pine platform offers a lenders portal for lenders to manage their segregated pools and loan offers. Lenders can use this portal for pool creation, loan management and collateral repossession. Other features, such as loan marketplace analytics, will be available to help lenders optimize their yield generation and risk management.
Seamless Financing: The Pine platform offers different financing options for the purchasing of NFTs on open marketplaces. Buyers can bid on or outright buy a NFT with a mortgage or to finance the purchase of a NFT using their existing portfolio of NFTs as collateral.
Pine Listing: Collateral Listing is a critical piece to enabling margin trading of NFTs. Users would be able to list their NFTs for sale even if they are currently serving as a collateral of an outstanding loan. A key constraint is that the sales price must be greater than the total outstanding loan amount. When the sale is done, part of the proceeds would first be used to repay any existing loan associated with the NFT automatically and the seller can pocket the rest.
Credit Market: The loans by default are not negotiable instruments. Pine endeavors to build the most efficient market by tokenizing the loans and creates secondary markets for both sides of the credit market. Tokenized lender position (promissory note) and tokenized borrower position (collateral receipt) will be transferable and freely tradable in the secondary credit markets.
AML Compliance: The protocol works with third-party on-chain compliance platforms to enable address screening. Lenders or borrowers can opt in to be compliant if their address is verified to be below certain risk levels. They can then further choose to only interact with counterparties that are also compliant on the protocol.

Pine Token

The Pine Token ("$PINE") is the ecosystem token for the Pine Protocol issued by the PineDAO. The structure, distribution, emission schedule and utilities of $PINE have been designed meticulously to make the protocol scalable and sustainable.

The token is expected to launch in Q1 2023 alongside with the launch of some of the utilities for the token.

Distribution

The total supply of token is hard capped at 200,000,000 and the distributions are as follows.

Category	Alloc	Months	Emission
Team	18.00%	36	0% at TGE, 2% unlock at month 6, 98% linearly from month 7 to month 36
Seed	7.97%	18	2.5% at TGE, 97.5% linearly from month 2 to month 18
Private & Advisor	9.44%	21	0% at TGE, 3% at month 3, 97% linearly from month 4 to month 21
IDO	0.67%	-	100% at TGE
Protocol Incentives	30.00%	24-36	Linearly - see section on incentives for more detail
Liquidity	1.00%	-	100% at TGE
Partnership	14.92%	21	Quarterly over 21 months
Treasury	18.00%	12	Linearly over 12 months; locked up and managed by the DAO / community

Guides

Don't miss a beat with all of our tailored step-by step guides to steer you into the right direction.

At Pine we are constantly innovating and providing new features to make buying, borrowing, selling or lending not only easier, but also more flexible and fun making Pine Protocol the premium and most complete NFT-backed lending platform.

Borrowing Do you own an NFT and the collection is available on our pools list? See how to borrow liquidity here by taking out a loan. Text Guide:

Borrowing Video Guide:

Video Guide by our own Community Manager, EJ!

Lending Want to earn passive income or provide additionality utility for your community? Whatever reason you might have to become a lender, you will find all the juicy details here.

Guide: Lending

Pine Now Pay Later Looking to buy a brand new NFT, but you're short on liquidity or prefer to reduce risk by only paying roughly half of its sell price? Pine Now Pay Later makes it happen by taking out a loan instantly and securing that precious NFT for you!

Guide: Pine Now Pay Later

Roadmap

Product Phases

V1 - Alpha (Jan 2022 - Mar 2022)

First functional version of Pine

V2 - Beta (Mar 2022 - Current)

Enhanced features and lender's portal

V3 - Public (Q4 2022)

Robust NFT-backed loan protocol and a two-sided NFT-backed loan marketplace

Timeline

Time	Item	Description
Jan 2022	Nassec Audit (v1)	v1 smart contract audit
Feb 2022	NFT-backed borrowing	Allows NFT holders to make permissionless loans in ETH
Mar 2022	Pine Now Pay Later	Allows buyers to PNPL on NFT marketplaces
May 2022	Quantstamp Audit (V2)	V2 smart contract audit
Jun 2022	Loan rollover	Allows loans to be extended on-chain
Aug 2022	Lender’s Portal	Allows anyone to set up lending pools
Sept 2022	Loan orderbook	Allows borrowers to browse and select from multiple pools when initiating and rolling over loans
Oct 2022	Pine Listing	Allows listing of collaterals for sale
Dec 2022	Auto roll-over	Allows borrowers to automatically rollover if LTV is below threshold
Q1 2023	Multi chain and currency support	Protocol extends to support multiple chains (Solana, BNBChain, AVAX, etc) and payout/repayment in more currencies (USDT, USDC, SOL, etc)
Q2 2023	Credit Marketplace	Allows lenders to buy and sell loan positions

How and Where to Buy PINE token?

PINE has been listed on a number of crypto exchanges, unlike other main cryptocurrencies, it cannot be directly purchased with fiats money. However, You can still easily buy this coin by first buying Bitcoin, ETH, USDT, BNB from any large exchanges and then transfer to the exchange that offers to trade this coin, in this guide article we will walk you through in detail the steps to buy PINE token

You will have to first buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…

We will use Binance Exchange here as it is one of the largest crypto exchanges that accept fiat deposits.

Once you finished the KYC process. You will be asked to add a payment method. Here you can either choose to provide a credit/debit card or use a bank transfer, and buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…

☞ SIGN UP ON BINANCE

Once finished you will then need to make a BTC/ETH/USDT/BNB deposit to the exchange from Binance depending on the available market pairs. After the deposit is confirmed you may then purchase PINE from the exchange.

The top exchange for trading in PINE token is currently: Impossible Finance

Top exchanges for token-coin trading. Follow instructions and make unlimited money

☞ Binance ☞ Poloniex ☞ Bitfinex ☞ Huobi ☞ MXC ☞ ProBIT ☞ Gate.io

If you’re a beginner. I believe the article below will be useful to you ☞ What You Should Know Before Investing in Cryptocurrency - For Beginner

Find more information PINE token ☞ Website

I hope this post will help you. Don't forget to leave a like, comment and sharing it with others. Thank you!

🔺DISCLAIMER: The Information in the post isn’t financial advice, is intended FOR GENERAL INFORMATION PURPOSES ONLY. Trading Cryptocurrency is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money.

#bitcoin #cryptocurrency #token #coin

What is GEEK

Buddha Community

What is Pine Protocol (PINE) | What is PINE token

Mohammed Richards

1659601560

Words Counted: A Ruby Natural Language Processor.

WordsCounted

We are all in the gutter, but some of us are looking at the stars.
-- Oscar Wilde

WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.

Are you using WordsCounted to do something interesting? Please tell me about it.

Demo

Visit this website for one example of what you can do with WordsCounted.

Features

Out of the box, get the following data from any string or readable file, or URL:
- Token count and unique token count
- Token densities, frequencies, and lengths
- Char count and average chars per token
- The longest tokens and their lengths
- The most frequent tokens and their frequencies.
A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as ["Bayrūt"] and not ["Bayr", "ū", "t"], for example.
Opens and reads files. Pass in a file path or a url instead of a string.

Installation

Add this line to your application's Gemfile:

gem 'words_counted'

And then execute:

$ bundle

Or install it yourself as:

$ gem install words_counted

Usage

Pass in a string or a file path, and an optional filter and/or regexp.

counter = WordsCounted.count(
  "We are all in the gutter, but some of us are looking at the stars."
)

# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")

.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.

API

WordsCounted

WordsCounted.count(input, options = {})

Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.count("Hello Beirut!")

Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.

WordsCounted.from_file(path, options = {})

Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.from_file("hello_beirut.txt")

Accepts the same options as .count.

Tokeniser

The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.

Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.

#tokenise([pattern: TOKEN_REGEXP, exclude: nil])

tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise

# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")

# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)

See Excluding tokens from the analyser and Passing in a custom regexp for more information.

Counter

The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.

#token_count

Returns the token count of a given string.

counter.token_count #=> 15

#token_frequency

Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.

counter.token_frequency

[
  ["the", 2],
  ["are", 2],
  ["we",  1],
  # ...
  ["all", 1]
]

#most_frequent_tokens

Returns a hash where each key-value pair is a token and its frequency.

counter.most_frequent_tokens

{ "are" => 2, "the" => 2 }

#token_lengths

Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.

counter.token_lengths

[
  ["looking", 7],
  ["gutter",  6],
  ["stars",   5],
  # ...
  ["in",      2]
]

#longest_tokens

Returns a hash where each key-value pair is a token and its length.

counter.longest_tokens

{ "looking" => 7 }

#token_density([ precision: 2 ])

Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.

counter.token_density

[
  ["are",     0.13],
  ["the",     0.13],
  ["but",     0.07 ],
  # ...
  ["we",      0.07 ]
]

#char_count

Returns the char count of tokens.

counter.char_count #=> 76

#average_chars_per_token([ precision: 2 ])

Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.

counter.average_chars_per_token #=> 4

#uniq_token_count

Returns the number of unique tokens.

counter.uniq_token_count #=> 13

Excluding tokens from the tokeniser

You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.

A space-delimited string. The filter will normalise the string.
A regular expression.
A lambda.
A symbol that names a predicate method. For example :odd?.
An array of any combination of the above.

tokeniser =
  WordsCounted::Tokeniser.new(
    "Magnificent! That was magnificent, Trevor."
  )

# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]

# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]

# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]

# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]

# Using an array
tokeniser = WordsCounted::Tokeniser.new(
  "Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
  exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]

Passing in a custom regexp

The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.

/[\p{Alpha}\-']+/

You can pass your own criteria as a Ruby regular expression to split your string as desired.

For example, if you wanted to include numbers, you can override the regular expression:

counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]

Opening and reading files

Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.

counter = WordsCounted.from_file("url/or/path/to/file.text")

Gotchas

A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.

counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency

[
  ["do",   2],
  ["how",  1],
  ["you",  1],
  ["-you", 1], # WTF, mate!
  ["are",  1],
  # ...
]

In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.

A note on case sensitivity

The program will normalise (downcase) all incoming strings for consistency and filters.

Roadmap

Ability to open URLs

def self.from_url
  # open url and send string here after removing html
end

Contributors

See contributors.

Contributing

Fork it
Create your feature branch (git checkout -b my-new-feature)
Commit your changes (git commit -am 'Add some feature')
Push to the branch (git push origin my-new-feature)
Create new Pull Request

Author: abitdodgy
Source code: https://github.com/abitdodgy/words_counted
License: MIT license

#ruby #ruby-on-rails

Royce Reinger

1658068560

WordsCounted: A Ruby Natural Language Processor

WordsCounted

We are all in the gutter, but some of us are looking at the stars.
-- Oscar Wilde

WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.

Features

Out of the box, get the following data from any string or readable file, or URL:
- Token count and unique token count
- Token densities, frequencies, and lengths
- Char count and average chars per token
- The longest tokens and their lengths
- The most frequent tokens and their frequencies.
A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as ["Bayrūt"] and not ["Bayr", "ū", "t"], for example.
Opens and reads files. Pass in a file path or a url instead of a string.

Installation

Add this line to your application's Gemfile:

gem 'words_counted'

And then execute:

$ bundle

Or install it yourself as:

$ gem install words_counted

Usage

Pass in a string or a file path, and an optional filter and/or regexp.

counter = WordsCounted.count(
  "We are all in the gutter, but some of us are looking at the stars."
)

# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")

.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.

API

WordsCounted

WordsCounted.count(input, options = {})

Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.count("Hello Beirut!")

Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.

WordsCounted.from_file(path, options = {})

Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.from_file("hello_beirut.txt")

Accepts the same options as .count.

Tokeniser

The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.

Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.

#tokenise([pattern: TOKEN_REGEXP, exclude: nil])

tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise

# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")

# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)

See Excluding tokens from the analyser and Passing in a custom regexp for more information.

Counter

The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.

#token_count

Returns the token count of a given string.

counter.token_count #=> 15

#token_frequency

Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.

counter.token_frequency

[
  ["the", 2],
  ["are", 2],
  ["we",  1],
  # ...
  ["all", 1]
]

#most_frequent_tokens

Returns a hash where each key-value pair is a token and its frequency.

counter.most_frequent_tokens

{ "are" => 2, "the" => 2 }

#token_lengths

Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.

counter.token_lengths

[
  ["looking", 7],
  ["gutter",  6],
  ["stars",   5],
  # ...
  ["in",      2]
]

#longest_tokens

Returns a hash where each key-value pair is a token and its length.

counter.longest_tokens

{ "looking" => 7 }

#token_density([ precision: 2 ])

Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.

counter.token_density

[
  ["are",     0.13],
  ["the",     0.13],
  ["but",     0.07 ],
  # ...
  ["we",      0.07 ]
]

#char_count

Returns the char count of tokens.

counter.char_count #=> 76

#average_chars_per_token([ precision: 2 ])

Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.

counter.average_chars_per_token #=> 4

#uniq_token_count

Returns the number of unique tokens.

counter.uniq_token_count #=> 13

Excluding tokens from the tokeniser

You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.

A space-delimited string. The filter will normalise the string.
A regular expression.
A lambda.
A symbol that names a predicate method. For example :odd?.
An array of any combination of the above.

tokeniser =
  WordsCounted::Tokeniser.new(
    "Magnificent! That was magnificent, Trevor."
  )

# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]

# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]

# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]

# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]

# Using an array
tokeniser = WordsCounted::Tokeniser.new(
  "Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
  exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]

Passing in a custom regexp

The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.

/[\p{Alpha}\-']+/

You can pass your own criteria as a Ruby regular expression to split your string as desired.

For example, if you wanted to include numbers, you can override the regular expression:

counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]

Opening and reading files

Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.

counter = WordsCounted.from_file("url/or/path/to/file.text")

Gotchas

A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.

counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency

[
  ["do",   2],
  ["how",  1],
  ["you",  1],
  ["-you", 1], # WTF, mate!
  ["are",  1],
  # ...
]

In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.

A note on case sensitivity

The program will normalise (downcase) all incoming strings for consistency and filters.

Roadmap

Ability to open URLs

def self.from_url
  # open url and send string here after removing html
end

Are you using WordsCounted to do something interesting? Please tell me about it.

RubyDoc documentation.

Demo

Visit this website for one example of what you can do with WordsCounted.

Contributors

See contributors.

Contributing

Fork it
Create your feature branch (git checkout -b my-new-feature)
Commit your changes (git commit -am 'Add some feature')
Push to the branch (git push origin my-new-feature)
Create new Pull Request

Author: Abitdodgy
Source Code: https://github.com/abitdodgy/words_counted
License: MIT license

#ruby #nlp

aaron silva

1622197808

SafeMoon Clone | Create A DeFi Token Like SafeMoon | DeFi token like SafeMoon

SafeMoon is a decentralized finance (DeFi) token. This token consists of RFI tokenomics and auto-liquidity generating protocol. A DeFi token like SafeMoon has reached the mainstream standards under the Binance Smart Chain. Its success and popularity have been immense, thus, making the majority of the business firms adopt this style of cryptocurrency as an alternative.

A DeFi token like SafeMoon is almost similar to the other crypto-token, but the only difference being that it charges a 10% transaction fee from the users who sell their tokens, in which 5% of the fee is distributed to the remaining SafeMoon owners. This feature rewards the owners for holding onto their tokens.

Read More @ https://bit.ly/3oFbJoJ

#create a defi token like safemoon #defi token like safemoon #safemoon token #safemoon token clone #defi token

aaron silva

1621844791

SafeMoon Clone | SafeMoon Token Clone | SafeMoon Token Clone Development

The SafeMoon Token Clone Development is the new trendsetter in the digital world that brought significant changes to benefit the growth of investors’ business in a short period. The SafeMoon token clone is the most widely discussed topic among global users for its value soaring high in the marketplace. The SafeMoon token development is a combination of RFI tokenomics and the auto-liquidity generating process. The SafeMoon token is a replica of decentralized finance (DeFi) tokens that are highly scalable and implemented with tamper-proof security.

The SafeMoon tokens execute efficient functionalities like RFI Static Rewards, Automated Liquidity Provisions, and Automatic Token Burns. The SafeMoon token is considered the most advanced stable coin in the crypto market. It gained global audience attention for managing the stability of asset value without any fluctuations in the marketplace. The SafeMoon token clone is completely decentralized that eliminates the need for intermediaries and benefits the users with less transaction fee and wait time to overtake the traditional banking process.

Reasons to invest in SafeMoon Token Clone :

The SafeMoon token clone benefits the investors with Automated Liquidity Pool as a unique feature since it adds more revenue for their business growth in less time. The traders can experience instant trade round the clock for reaping profits with less investment towards the SafeMoon token.
It is integrated with high-end security protocols like two-factor authentication and signature process to prevent various hacks and vulnerable activities. The Smart Contract system in SafeMoon token development manages the overall operation of transactions without any delay,
The users can obtain a reward amount based on the volume of SafeMoon tokens traded in the marketplace. The efficient trading mechanism allows the users to trade the SafeMoon tokens at the best price for farming. The user can earn higher rewards based on the staking volume of tokens by users in the trade market.
It allows the token holders to gain complete ownership over their SafeMoon tokens after purchasing from DeFi exchanges. The SafeMoon community governs the token distribution, price fluctuations, staking, and every other token activity. The community boosts the value of SafeMoon tokens.
The Automated Burning tokens result in the community no longer having control over the SafeMoon tokens. Instead, the community can control the burn of the tokens efficiently for promoting its value in the marketplace. The transaction of SafeMoon tokens on the blockchain platform is fast, safe, and secure.

The SafeMoon Token Clone Development is a promising future for upcoming investors and startups to increase their business revenue in less time. The SafeMoon token clone has great demand in the real world among millions of users for its value in the market. Investors can contact leading Infinite Block Tech to gain proper assistance in developing a world-class SafeMoon token clone that increases the business growth in less time.

#safemoon token #safemoon token clone #safemoon token clone development #defi token

Coin Introduction

1671863717