1624240996
What is Kawakami Finance (KKI) | What is Kawakami Finance token | What is KKI token
In this article, we’ll discuss information about the Kawakami Finance project and KKI token
Kawakami Inu is a descendant of wolves. Therefore, leading to reduce the number of wolves, the Kawakami becomes the rarest dog in Japan because there are only about 80 identical individuals left. This is a cross between a forest and a domestic dog
Kawakami Inu - Inu With Real Use Case
Kawakami (KKI)is a charity token the purpose of which is to create strong, wild dogs that are good at hunting wolf breeds as cute and easy as Shiba. by harnessing the power of NFT and blockchain.
Kawakami is a community-driven charity Token. So the ownership has been renounced and control is given in the hands of the Kawakami Inu.
Token Info
Join over a million people
PANCAKESWAP
Under “Slippage Tolerance”, enter a custom value, between 11–15%. Start low and increase if you get an error message when swapping
TOKENOMICS
🐶 Kawakami Total Supply & Holders
🐶 Ownership Renounced
🐶 Starting supply = 100,000,000 Tokens
🐶 There will be 10 tax on all transactions, 7% of which will be proportionately distributed to all HODLers automatically.
FEATURES
✔️ Verified Contract
✔️ Active developers
✔️ Frictionless yield generation
✔️ Unruggable, LP burned
✔️ Hold and earn, thats it!
✔️ One of the most active Telegram communities
✔️ 100% transparency with community
✔️ Prize contests every week
✔️ NFT marketplace for early adopters
✔️ Charity and strategic partnerships
✔️ Learn more about Kawakami features
OUR PURPOSE
‘Started with a meme, saving and growing with a purpose.’ - Kawakami Community
✔️MEME-BASED
Like AMC and GME, memes are the new thing in 2021. This momentum has driven up the adoption of cryptocurrency as a safer financial tool than traditional markets.
✔️COLLABORATION
We will have NFTs (Non-fungible tokens) art with famous artist coming up. This is also a great saving tool and also helping the artists to monetize their art works.
Our Roadmap
Q2 2021
STAGE 1
- Core Development ✅
- Marketing (ads/influencers) ✅
- Coingecko Integration ✅
- CoinMarketCap Integration ✅
- Coinbase Tracking ✅
- First Charity Donation** ✅**
- Blockfolio Integration
- NFT Platform Launch
Q3 2021
STAGE 2
-Establish a partnership network that is bound to make KKI INU conquer the cryptosphere
- CEX Listing ✅
- KKI Swap DeFi Platform Beta Launch
- KKI INU Social Platform Beta release
Q4 2021
STAGE 3
- Tier 1 CEX Listings
- Larger scale marketing
- KKI Swap DeFi Platform Full Release
- KKI INU Social Platform Full release
Q1 2022
STAGE 4
- NFT auctions to fund bigger scale donations
- Saving all the dogs in the world from suffering
How and Where to Buy KKI token?
KKI token is now live on the Binance mainnet. The token address for KKI is 0x270522add6b1db29e3d764f3adf9c07f56e46f8e. Be cautious not to purchase any other token with a smart contract different from this one (as this can be easily faked). We strongly advise to be vigilant and stay safe throughout the launch. Don’t let the excitement get the best of you.
Just be sure you have enough BNB in your wallet to cover the transaction fees.
Join To Get BNB (Binance Coin)! ☞ CLICK HERE
You will have to first buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…
We will use Binance Exchange here as it is one of the largest crypto exchanges that accept fiat deposits.
Once you finished the KYC process. You will be asked to add a payment method. Here you can either choose to provide a credit/debit card or use a bank transfer, and buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…
Step by Step Guide : What is Binance | How to Create an account on Binance (Updated 2021)
Next step
STEP 1
INSTALL METAMASK WALLET
Metamask is a browser extension & mobile app that acts as a wallet used to store BEP-20 such as Kawakami .
Follow the instructions from Metamask on how to install the wallet in your browser or device.
ADD NETWORK
You will need to add the Binance Smart Chain Network to be able to buy the Kawakami
Firstly, select the button on the top labeled “Ethereum Mainnet” (default value) in your Metamask wallet and click “Custom RPC” and Enter the Details below:
Network Name: Binance Smart Chain
New RPC URL: https://bsc-dataseed.binance.org/
ChainID: 56
Symbol: BNB
Block Explorer URL: https://bscscan.com
For a more detailed guide visit the official guide from a Binance.
WITHDRAW BNB TO METAMASK
In your Binance account, open your BNB wallet then tap on Withdraw.
Select Binance Smart Chain (BSC) as the Transfer Network.
Ensure that you select that you want to withdraw BEP-20 (BSC) tokens.
Copy your address from your Metamask wallet and choose the amount you want to withdraw
Make sure the network tab in your Metamask wallet is set to “Binance Smart Chain”
Complete the steps to withdraw.
Wait for the exchange to process your request. Once it is confirmed, you will immediately receive BNB to your Smart Chain address.
STEP 2
ADD Kawakami TO YOUR WALLET
Make sure the network tab in your Metamask wallet is set to “Binance Smart Chain”
In your Metamask wallet scroll down to the button “Add Token”
Select “Custom Token”
Paste the Kawakami contract address into the “Token Contract Address” field. All other fields will automatically be filled in.
0x270522aDD6b1dB29E3D764F3AdF9C07F56e46f8E
In your metamask wallet scroll down to the button “Add Token”
Click “Next” then click “Add Token”
Congratulations your now a Kawakami TOKEN holder!
STEP 4
EXCHANGE BNB FOR Kawakami ON PANCAKESWAP
Make sure the network tab in your Metamask wallet is set to “Binance Smart Chain”. Follow the PancakeSwap link to exchange on website and swap your BNB for Kawakami . Make sure slippage is set to 11-15% by selecting the gear icon next to the “Exchange” title.
Ensure when swapping BNB for Kawakami the Official contract address is selected for the “to” token.
Official Kawakami token Address: 0x270522aDD6b1dB29E3D764F3AdF9C07F56e46f8E
Read more: What is Pancakeswap | Beginner’s Guide on How to Use Pancakeswap
The top exchange for trading in KKI token is currently PancakeSwap (V2) and Resfinex
Find more information KKI
☞ Website ☞ Explorer ☞ Source Code ☞ Social Channel ☞ Social Channel 2 ☞ Social Channel 3 ☞ Coinmarketcap
🔺DISCLAIMER: The Information in the post isn’t financial advice, is intended FOR GENERAL INFORMATION PURPOSES ONLY. Trading Cryptocurrency is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money.
🔥 If you’re a beginner. I believe the article below will be useful to you ☞ What You Should Know Before Investing in Cryptocurrency - For Beginner
⭐ ⭐ ⭐The project is of interest to the community. Join to Get free ‘GEEK coin’ (GEEKCASH coin)!
☞ **-----https://geekcash.org-----**⭐ ⭐ ⭐
I hope this post will help you. Don’t forget to leave a like, comment and sharing it with others. Thank you!
#blockchain #bitcoin #kki #kawakami finance
What is GEEK
Buddha Community
1624240996
What is Kawakami Finance (KKI) | What is Kawakami Finance token | What is KKI token
In this article, we’ll discuss information about the Kawakami Finance project and KKI token
Kawakami Inu is a descendant of wolves. Therefore, leading to reduce the number of wolves, the Kawakami becomes the rarest dog in Japan because there are only about 80 identical individuals left. This is a cross between a forest and a domestic dog
Kawakami Inu - Inu With Real Use Case
Kawakami (KKI)is a charity token the purpose of which is to create strong, wild dogs that are good at hunting wolf breeds as cute and easy as Shiba. by harnessing the power of NFT and blockchain.
Kawakami is a community-driven charity Token. So the ownership has been renounced and control is given in the hands of the Kawakami Inu.
Token Info
Join over a million people
PANCAKESWAP
Under “Slippage Tolerance”, enter a custom value, between 11–15%. Start low and increase if you get an error message when swapping
TOKENOMICS
🐶 Kawakami Total Supply & Holders
🐶 Ownership Renounced
🐶 Starting supply = 100,000,000 Tokens
🐶 There will be 10 tax on all transactions, 7% of which will be proportionately distributed to all HODLers automatically.
FEATURES
✔️ Verified Contract
✔️ Active developers
✔️ Frictionless yield generation
✔️ Unruggable, LP burned
✔️ Hold and earn, thats it!
✔️ One of the most active Telegram communities
✔️ 100% transparency with community
✔️ Prize contests every week
✔️ NFT marketplace for early adopters
✔️ Charity and strategic partnerships
✔️ Learn more about Kawakami features
OUR PURPOSE
‘Started with a meme, saving and growing with a purpose.’ - Kawakami Community
✔️MEME-BASED
Like AMC and GME, memes are the new thing in 2021. This momentum has driven up the adoption of cryptocurrency as a safer financial tool than traditional markets.
✔️COLLABORATION
We will have NFTs (Non-fungible tokens) art with famous artist coming up. This is also a great saving tool and also helping the artists to monetize their art works.
Our Roadmap
Q2 2021
STAGE 1
- Core Development ✅
- Marketing (ads/influencers) ✅
- Coingecko Integration ✅
- CoinMarketCap Integration ✅
- Coinbase Tracking ✅
- First Charity Donation** ✅**
- Blockfolio Integration
- NFT Platform Launch
Q3 2021
STAGE 2
-Establish a partnership network that is bound to make KKI INU conquer the cryptosphere
- CEX Listing ✅
- KKI Swap DeFi Platform Beta Launch
- KKI INU Social Platform Beta release
Q4 2021
STAGE 3
- Tier 1 CEX Listings
- Larger scale marketing
- KKI Swap DeFi Platform Full Release
- KKI INU Social Platform Full release
Q1 2022
STAGE 4
- NFT auctions to fund bigger scale donations
- Saving all the dogs in the world from suffering
How and Where to Buy KKI token?
KKI token is now live on the Binance mainnet. The token address for KKI is 0x270522add6b1db29e3d764f3adf9c07f56e46f8e. Be cautious not to purchase any other token with a smart contract different from this one (as this can be easily faked). We strongly advise to be vigilant and stay safe throughout the launch. Don’t let the excitement get the best of you.
Just be sure you have enough BNB in your wallet to cover the transaction fees.
Join To Get BNB (Binance Coin)! ☞ CLICK HERE
You will have to first buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…
We will use Binance Exchange here as it is one of the largest crypto exchanges that accept fiat deposits.
Once you finished the KYC process. You will be asked to add a payment method. Here you can either choose to provide a credit/debit card or use a bank transfer, and buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…
Step by Step Guide : What is Binance | How to Create an account on Binance (Updated 2021)
Next step
STEP 1
INSTALL METAMASK WALLET
Metamask is a browser extension & mobile app that acts as a wallet used to store BEP-20 such as Kawakami .
Follow the instructions from Metamask on how to install the wallet in your browser or device.
ADD NETWORK
You will need to add the Binance Smart Chain Network to be able to buy the Kawakami
Firstly, select the button on the top labeled “Ethereum Mainnet” (default value) in your Metamask wallet and click “Custom RPC” and Enter the Details below:
Network Name: Binance Smart Chain
New RPC URL: https://bsc-dataseed.binance.org/
ChainID: 56
Symbol: BNB
Block Explorer URL: https://bscscan.com
For a more detailed guide visit the official guide from a Binance.
WITHDRAW BNB TO METAMASK
In your Binance account, open your BNB wallet then tap on Withdraw.
Select Binance Smart Chain (BSC) as the Transfer Network.
Ensure that you select that you want to withdraw BEP-20 (BSC) tokens.
Copy your address from your Metamask wallet and choose the amount you want to withdraw
Make sure the network tab in your Metamask wallet is set to “Binance Smart Chain”
Complete the steps to withdraw.
Wait for the exchange to process your request. Once it is confirmed, you will immediately receive BNB to your Smart Chain address.
STEP 2
ADD Kawakami TO YOUR WALLET
Make sure the network tab in your Metamask wallet is set to “Binance Smart Chain”
In your Metamask wallet scroll down to the button “Add Token”
Select “Custom Token”
Paste the Kawakami contract address into the “Token Contract Address” field. All other fields will automatically be filled in.
0x270522aDD6b1dB29E3D764F3AdF9C07F56e46f8E
In your metamask wallet scroll down to the button “Add Token”
Click “Next” then click “Add Token”
Congratulations your now a Kawakami TOKEN holder!
STEP 4
EXCHANGE BNB FOR Kawakami ON PANCAKESWAP
Make sure the network tab in your Metamask wallet is set to “Binance Smart Chain”. Follow the PancakeSwap link to exchange on website and swap your BNB for Kawakami . Make sure slippage is set to 11-15% by selecting the gear icon next to the “Exchange” title.
Ensure when swapping BNB for Kawakami the Official contract address is selected for the “to” token.
Official Kawakami token Address: 0x270522aDD6b1dB29E3D764F3AdF9C07F56e46f8E
Read more: What is Pancakeswap | Beginner’s Guide on How to Use Pancakeswap
The top exchange for trading in KKI token is currently PancakeSwap (V2) and Resfinex
Find more information KKI
☞ Website ☞ Explorer ☞ Source Code ☞ Social Channel ☞ Social Channel 2 ☞ Social Channel 3 ☞ Coinmarketcap
🔺DISCLAIMER: The Information in the post isn’t financial advice, is intended FOR GENERAL INFORMATION PURPOSES ONLY. Trading Cryptocurrency is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money.
🔥 If you’re a beginner. I believe the article below will be useful to you ☞ What You Should Know Before Investing in Cryptocurrency - For Beginner
⭐ ⭐ ⭐The project is of interest to the community. Join to Get free ‘GEEK coin’ (GEEKCASH coin)!
☞ **-----https://geekcash.org-----**⭐ ⭐ ⭐
I hope this post will help you. Don’t forget to leave a like, comment and sharing it with others. Thank you!
#blockchain #bitcoin #kki #kawakami finance
1624219980
How to Buy NFT Art Finance Token - The EASIEST METHOD! DO NOT MISS!!! JUST IN 4 MINUTES
NFT Art Finance is currently one of the most popular cryptocurrencies right now on the market, so in today’s video, I will be showing you guys how to easily buy NFT Art Finance on your phone using the Trust Wallet application.
📺 The video in this post was made by More LimSanity
The origin of the article: https://www.youtube.com/watch?v=sKE6Pc_w1IE
🔺 DISCLAIMER: The article is for information sharing. The content of this video is solely the opinions of the speaker who is not a licensed financial advisor or registered investment advisor. Not investment advice or legal advice.
Cryptocurrency trading is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money
🔥 If you’re a beginner. I believe the article below will be useful to you ☞ What You Should Know Before Investing in Cryptocurrency - For Beginner
⭐ ⭐ ⭐The project is of interest to the community. Join to Get free ‘GEEK coin’ (GEEKCASH coin)!
☞ **-----CLICK HERE-----**⭐ ⭐ ⭐
Thanks for visiting and watching! Please don’t forget to leave a like, comment and share!
#bitcoin #blockchain #nft art finance token #token #buy nft art finance #how to buy nft art finance token - the easiest method!
1624312800
SPORE FINANCE PREDICTION - WHAT IS SPORE FINANCE & SPORE FINANCE ANALYSIS - SPORE FINANCE
SPORE FINANCE PREDICTION - WHAT IS SPORE FINANCE & SPORE FINANCE ANALYSIS - SPORE FINANCE
In this video, I talk about spore finance coin and give my spore finance prediction. I talk about the latest spore finance analysis & spore finance crypto coin that recently has been hit pretty hard in the last 24 hours. I go over what is spore finance and how many holders are on this new crypto coin spore finance.
📺 The video in this post was made by Josh’s Finance
The origin of the article: https://www.youtube.com/watch?v=qbPQvdxCtEI
🔺 DISCLAIMER: The article is for information sharing. The content of this video is solely the opinions of the speaker who is not a licensed financial advisor or registered investment advisor. Not investment advice or legal advice.
Cryptocurrency trading is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money
🔥 If you’re a beginner. I believe the article below will be useful to you ☞ What You Should Know Before Investing in Cryptocurrency - For Beginner
⭐ ⭐ ⭐The project is of interest to the community. Join to Get free ‘GEEK coin’ (GEEKCASH coin)!
☞ **-----CLICK HERE-----**⭐ ⭐ ⭐
Thanks for visiting and watching! Please don’t forget to leave a like, comment and share!
#bitcoin #blockchain #spore finance #what is spore finance #spore finance prediction - what is spore finance & spore finance analysis - spore finance #spore finance prediction
1658068560
WordsCounted: A Ruby Natural Language Processor
WordsCounted
We are all in the gutter, but some of us are looking at the stars.
-- Oscar Wilde
WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.
Features
- Out of the box, get the following data from any string or readable file, or URL:
- Token count and unique token count
- Token densities, frequencies, and lengths
- Char count and average chars per token
- The longest tokens and their lengths
- The most frequent tokens and their frequencies.
- A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
- Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as
["Bayrūt"]and not["Bayr", "ū", "t"], for example. - Opens and reads files. Pass in a file path or a url instead of a string.
Installation
Add this line to your application's Gemfile:
gem 'words_counted'
And then execute:
$ bundle
Or install it yourself as:
$ gem install words_counted
Usage
Pass in a string or a file path, and an optional filter and/or regexp.
counter = WordsCounted.count(
"We are all in the gutter, but some of us are looking at the stars."
)
# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")
.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.
API
WordsCounted
WordsCounted.count(input, options = {})
Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.
counter = WordsCounted.count("Hello Beirut!")
Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.
WordsCounted.from_file(path, options = {})
Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.
counter = WordsCounted.from_file("hello_beirut.txt")
Accepts the same options as .count.
Tokeniser
The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.
Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.
#tokenise([pattern: TOKEN_REGEXP, exclude: nil])
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise
# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")
# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)
See Excluding tokens from the analyser and Passing in a custom regexp for more information.
Counter
The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.
#token_count
Returns the token count of a given string.
counter.token_count #=> 15
#token_frequency
Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.
counter.token_frequency
[
["the", 2],
["are", 2],
["we", 1],
# ...
["all", 1]
]
#most_frequent_tokens
Returns a hash where each key-value pair is a token and its frequency.
counter.most_frequent_tokens
{ "are" => 2, "the" => 2 }
#token_lengths
Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.
counter.token_lengths
[
["looking", 7],
["gutter", 6],
["stars", 5],
# ...
["in", 2]
]
#longest_tokens
Returns a hash where each key-value pair is a token and its length.
counter.longest_tokens
{ "looking" => 7 }
#token_density([ precision: 2 ])
Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.
counter.token_density
[
["are", 0.13],
["the", 0.13],
["but", 0.07 ],
# ...
["we", 0.07 ]
]
#char_count
Returns the char count of tokens.
counter.char_count #=> 76
#average_chars_per_token([ precision: 2 ])
Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.
counter.average_chars_per_token #=> 4
#uniq_token_count
Returns the number of unique tokens.
counter.uniq_token_count #=> 13
Excluding tokens from the tokeniser
You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.
- A space-delimited string. The filter will normalise the string.
- A regular expression.
- A lambda.
- A symbol that names a predicate method. For example
:odd?. - An array of any combination of the above.
tokeniser =
WordsCounted::Tokeniser.new(
"Magnificent! That was magnificent, Trevor."
)
# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]
# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]
# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]
# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]
# Using an array
tokeniser = WordsCounted::Tokeniser.new(
"Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]
Passing in a custom regexp
The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.
/[\p{Alpha}\-']+/
You can pass your own criteria as a Ruby regular expression to split your string as desired.
For example, if you wanted to include numbers, you can override the regular expression:
counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]
Opening and reading files
Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.
counter = WordsCounted.from_file("url/or/path/to/file.text")
Gotchas
A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.
counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency
[
["do", 2],
["how", 1],
["you", 1],
["-you", 1], # WTF, mate!
["are", 1],
# ...
]
In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.
A note on case sensitivity
The program will normalise (downcase) all incoming strings for consistency and filters.
Roadmap
Ability to open URLs
def self.from_url
# open url and send string here after removing html
end
Are you using WordsCounted to do something interesting? Please tell me about it.
Demo
Visit this website for one example of what you can do with WordsCounted.
Contributors
See contributors.
Contributing
- Fork it
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Add some feature') - Push to the branch (
git push origin my-new-feature) - Create new Pull Request
Author: Abitdodgy
Source Code: https://github.com/abitdodgy/words_counted
License: MIT license
1659601560
Words Counted: A Ruby Natural Language Processor.
WordsCounted
We are all in the gutter, but some of us are looking at the stars.
-- Oscar Wilde
WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.
Are you using WordsCounted to do something interesting? Please tell me about it.
Demo
Visit this website for one example of what you can do with WordsCounted.
Features
- Out of the box, get the following data from any string or readable file, or URL:
- Token count and unique token count
- Token densities, frequencies, and lengths
- Char count and average chars per token
- The longest tokens and their lengths
- The most frequent tokens and their frequencies.
- A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
- Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as
["Bayrūt"]and not["Bayr", "ū", "t"], for example. - Opens and reads files. Pass in a file path or a url instead of a string.
Installation
Add this line to your application's Gemfile:
gem 'words_counted'
And then execute:
$ bundle
Or install it yourself as:
$ gem install words_counted
Usage
Pass in a string or a file path, and an optional filter and/or regexp.
counter = WordsCounted.count(
"We are all in the gutter, but some of us are looking at the stars."
)
# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")
.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.
API
WordsCounted
WordsCounted.count(input, options = {})
Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.
counter = WordsCounted.count("Hello Beirut!")
Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.
WordsCounted.from_file(path, options = {})
Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.
counter = WordsCounted.from_file("hello_beirut.txt")
Accepts the same options as .count.
Tokeniser
The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.
Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.
#tokenise([pattern: TOKEN_REGEXP, exclude: nil])
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise
# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")
# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)
See Excluding tokens from the analyser and Passing in a custom regexp for more information.
Counter
The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.
#token_count
Returns the token count of a given string.
counter.token_count #=> 15
#token_frequency
Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.
counter.token_frequency
[
["the", 2],
["are", 2],
["we", 1],
# ...
["all", 1]
]
#most_frequent_tokens
Returns a hash where each key-value pair is a token and its frequency.
counter.most_frequent_tokens
{ "are" => 2, "the" => 2 }
#token_lengths
Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.
counter.token_lengths
[
["looking", 7],
["gutter", 6],
["stars", 5],
# ...
["in", 2]
]
#longest_tokens
Returns a hash where each key-value pair is a token and its length.
counter.longest_tokens
{ "looking" => 7 }
#token_density([ precision: 2 ])
Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.
counter.token_density
[
["are", 0.13],
["the", 0.13],
["but", 0.07 ],
# ...
["we", 0.07 ]
]
#char_count
Returns the char count of tokens.
counter.char_count #=> 76
#average_chars_per_token([ precision: 2 ])
Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.
counter.average_chars_per_token #=> 4
#uniq_token_count
Returns the number of unique tokens.
counter.uniq_token_count #=> 13
Excluding tokens from the tokeniser
You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.
- A space-delimited string. The filter will normalise the string.
- A regular expression.
- A lambda.
- A symbol that names a predicate method. For example
:odd?. - An array of any combination of the above.
tokeniser =
WordsCounted::Tokeniser.new(
"Magnificent! That was magnificent, Trevor."
)
# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]
# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]
# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]
# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]
# Using an array
tokeniser = WordsCounted::Tokeniser.new(
"Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]
Passing in a custom regexp
The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.
/[\p{Alpha}\-']+/
You can pass your own criteria as a Ruby regular expression to split your string as desired.
For example, if you wanted to include numbers, you can override the regular expression:
counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]
Opening and reading files
Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.
counter = WordsCounted.from_file("url/or/path/to/file.text")
Gotchas
A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.
counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency
[
["do", 2],
["how", 1],
["you", 1],
["-you", 1], # WTF, mate!
["are", 1],
# ...
]
In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.
A note on case sensitivity
The program will normalise (downcase) all incoming strings for consistency and filters.
Roadmap
Ability to open URLs
def self.from_url
# open url and send string here after removing html
end
Contributors
See contributors.
Contributing
- Fork it
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Add some feature') - Push to the branch (
git push origin my-new-feature) - Create new Pull Request
Author: abitdodgy
Source code: https://github.com/abitdodgy/words_counted
License: MIT license
#ruby #ruby-on-rails