1620630045
What is Trade Race Manager (IOI) | What is Trade Race Manager token | What is IOI token
In this article, we’ll discuss information about the Trade Race Manager project and IOI token
Trade Race Manager is the first crypto gaming and brand new blockchain game powered by IOI and NFTs, where you can collect, trade, race and earn.
The first Wednesday Race on TRM platform
On March 24, the first public beta test of Wednesday Race was held, and it was completely free for all users. This game was on IOI-game the most favourite race with a guaranteed trading pool and we are sure people will also love the new Wednesday Race on Trade Race Manager at least so much. So register now and join the race! Don’t forget that the early bird gets the worm!
TRM is getting known on Youtube
Apart from being noticed on the most known crypto media like Cointelegraph, NewsBTC etc., we are pleased that we attracted also well-known YouTubers like VoskCoin, John Acquaviva, Pro Blockchain and others.
NFT wallet and NFT market
Our NFT IOI-wallet has been up and running for the public since mid-March, so users can buy our NFT car collections in the wallet. The price starts from 600 IOI for the lowest bronze edition. There are four car tiers available for purchase. We have also conducted the first IOI NFT sale on the Arkane marketplace. NFT car was sold within seconds, which we consider as a great achievement. Soon there will be more NFT cars for sale on Arkane. Keep an eye on our social channels not to miss out on the announcements.
BGA giveaway
Did you attend the live event held by our partner BGA (Blockchain Game Alliance)? It was a great opportunity to learn more about Trade Race Manager, future development plans and all attendants had a chance to win great giveaway prizes. One of the prizes was an NFT car sponsored by IOI- corporation.
IOI token swap
Long awaiting token swap is already available for our users, and you can now transfer your IOI tokens from IOI- game onto the Trade Race Manager platform. As long as you have the same registered email on both platforms, you can migrate the tokens in one click. Simply click the “swap tokens” button after logging in to the old IOI-Game website, and your migration is done. You can find more detailed information about the token swap here.
As we have been working hard fort our users, we are looking forward to bring you another great news about the next progress soon.
Explore the Trade Race Manager game and start enjoying all the benefits the platform offers. You can still do your daily tasks for free tokens or play free races to learn the game and earn even more with other games.
Not a gamer? Then the NFT staking program might suits you better. You will love your daily rewards and with a rare car unlocked you will get your rewards doubled. And it’s still not everything. Discover all the possibilities on how to create multiple incomes with Trade Race Manager.
How to swap IOI tokens between platforms and what are the requirements:
- You can swap TRX deposited to the platform only before the 1st of March
- The minimum swap amount is the equivalent of 100 IOI
- The partial swap is not possible to do
- The total swap balance includes the both IOI game and Nitro wallet
- The players who created the Trade Race Manager account need to have the same registration email as in the IOI Game. They will get notified about the swap by email
- We will automatically create an account in the Trade Race Manager with the default password for the players who have NOT created the Trade Race Manager account. Do not forget to change the password.
We hope you have tried the game and enjoy the Trade Race Manager NFT launch together with the latest NFTs and IOI token wallet release.
Moreover, there is much more coming soon since the team is working hard to bring you spectacular game excitement.
IOI token
100mil: total supply
50mil.: burning plan
18mil: reward for players
15mil: team with time lock
12mil: reserve and partners
3mil: public sale
2mil.: private sales
Defi
- Listing on DEX (no KYC, no custody) - JustSwap, Oikos
- Possible liquidity mining for liquidity providers
- Explore other Defi opportunities like lending, borrowing or farming
Cefi
- Partnership with reputable Zizzy Group
- Utilising algo trading strategies and analytics
- Holding 1000 IOI Tokens - 24% APY
- Holding 10 000 IOI Tokens - 36% APY
- Dividend pool share in case of higher profits
Wallet
- Get staking up to 24% APY with IOI tokens
- Purchase cars to increase winning chance
- Holding 1000 IOI - 10 % from dividend pool
- Holding 10 000 IOI Tokens - 90 % from dividend pool
- Access to Never Lose Game
Game
- Play IOI game
- Purchase cars to increase winning chance
- Holding 1000 IOI - 10 % from dividend pool
- Holding 10 000 IOI Tokens - 90 % from dividend pool
- Access to Never Lose Game
Time lock for team
20.12.2021:20% released
20.12.2022: 20% released
20.12.2023: 20% released
20.12.2024: 40% released
60%: Plan to be burned
40%: Future supply
20%: Locked
1%: In circulation
Current IOI token usage
This is a forecast for current 20,000 players on platform
Would you like to earn TOKEN right now! ☞ CLICK HERE
How and Where to Buy Trade Race Manager (IOI)?
You will have to first buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…
We will use Binance Exchange here as it is one of the largest crypto exchanges that accept fiat deposits.
Once you finished the KYC process. You will be asked to add a payment method. Here you can either choose to provide a credit/debit card or use a bank transfer, and buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…
Step by Step Guide : What is Binance | How to Create an account on Binance (Updated 2021)
Next step
You need a wallet address to Connect to Uniswap Decentralized Exchange, we use Metamask wallet
If you don’t have a Metamask wallet, read this article and follow the steps
☞What is Metamask wallet | How to Create a wallet and Use
Transfer $ETH to your new Metamask wallet from your existing wallet
Next step
Connect Metamask wallet to Uniswap Decentralized Exchange and Buy, Swap IOI token
Read more: What is Uniswap | Beginner’s Guide on How to Use Uniswap
SINCE 10 MAY
Ticker: IOI
Token type: ERC20 ICO
Token Price: 1 IOI = 0.40 USD
Fundraising Goal: 500,000 TOKEN
**Total Tokens: **50,000,000
**Available for Token Sale: **10%
There are a few popular crypto exchanges where they have decent daily trading volumes and a huge user base. This will ensure you will be able to sell your coins at any time and the fees will usually be lower. It is suggested that you also register on these exchanges since once IOI gets listed there it will attract a large amount of trading volumes from the users there, that means you will be having some great trading opportunities!
Top exchanges for token-coin trading. Follow instructions and make unlimited money
☞ https://www.binance.com
☞ https://www.bittrex.com
☞ https://www.poloniex.com
☞ https://www.bitfinex.com
☞ https://www.huobi.com
Find more information IOI
☞ Website ☞ Announcement ☞ Social Channel ☞ Social Channel 2 ☞ Social Channel 3 ☞ Message Board ☞ Message Board 2 ☞ Tokenometrics ☞ Sales Details
🔺DISCLAIMER: The Information in the post isn’t financial advice, is intended FOR GENERAL INFORMATION PURPOSES ONLY. Trading Cryptocurrency is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money.
🔥 If you’re a beginner. I believe the article below will be useful to you
⭐ ⭐ ⭐ What You Should Know Before Investing in Cryptocurrency - For Beginner ⭐ ⭐ ⭐
I hope this post will help you. Don’t forget to leave a like, comment and sharing it with others. Thank you!
#blockchain #bitcoin #ioi #trade race manager
What is GEEK
Buddha Community
1620630045
What is Trade Race Manager (IOI) | What is Trade Race Manager token | What is IOI token
In this article, we’ll discuss information about the Trade Race Manager project and IOI token
Trade Race Manager is the first crypto gaming and brand new blockchain game powered by IOI and NFTs, where you can collect, trade, race and earn.
The first Wednesday Race on TRM platform
On March 24, the first public beta test of Wednesday Race was held, and it was completely free for all users. This game was on IOI-game the most favourite race with a guaranteed trading pool and we are sure people will also love the new Wednesday Race on Trade Race Manager at least so much. So register now and join the race! Don’t forget that the early bird gets the worm!
TRM is getting known on Youtube
Apart from being noticed on the most known crypto media like Cointelegraph, NewsBTC etc., we are pleased that we attracted also well-known YouTubers like VoskCoin, John Acquaviva, Pro Blockchain and others.
NFT wallet and NFT market
Our NFT IOI-wallet has been up and running for the public since mid-March, so users can buy our NFT car collections in the wallet. The price starts from 600 IOI for the lowest bronze edition. There are four car tiers available for purchase. We have also conducted the first IOI NFT sale on the Arkane marketplace. NFT car was sold within seconds, which we consider as a great achievement. Soon there will be more NFT cars for sale on Arkane. Keep an eye on our social channels not to miss out on the announcements.
BGA giveaway
Did you attend the live event held by our partner BGA (Blockchain Game Alliance)? It was a great opportunity to learn more about Trade Race Manager, future development plans and all attendants had a chance to win great giveaway prizes. One of the prizes was an NFT car sponsored by IOI- corporation.
IOI token swap
Long awaiting token swap is already available for our users, and you can now transfer your IOI tokens from IOI- game onto the Trade Race Manager platform. As long as you have the same registered email on both platforms, you can migrate the tokens in one click. Simply click the “swap tokens” button after logging in to the old IOI-Game website, and your migration is done. You can find more detailed information about the token swap here.
As we have been working hard fort our users, we are looking forward to bring you another great news about the next progress soon.
Explore the Trade Race Manager game and start enjoying all the benefits the platform offers. You can still do your daily tasks for free tokens or play free races to learn the game and earn even more with other games.
Not a gamer? Then the NFT staking program might suits you better. You will love your daily rewards and with a rare car unlocked you will get your rewards doubled. And it’s still not everything. Discover all the possibilities on how to create multiple incomes with Trade Race Manager.
How to swap IOI tokens between platforms and what are the requirements:
- You can swap TRX deposited to the platform only before the 1st of March
- The minimum swap amount is the equivalent of 100 IOI
- The partial swap is not possible to do
- The total swap balance includes the both IOI game and Nitro wallet
- The players who created the Trade Race Manager account need to have the same registration email as in the IOI Game. They will get notified about the swap by email
- We will automatically create an account in the Trade Race Manager with the default password for the players who have NOT created the Trade Race Manager account. Do not forget to change the password.
We hope you have tried the game and enjoy the Trade Race Manager NFT launch together with the latest NFTs and IOI token wallet release.
Moreover, there is much more coming soon since the team is working hard to bring you spectacular game excitement.
IOI token
100mil: total supply
50mil.: burning plan
18mil: reward for players
15mil: team with time lock
12mil: reserve and partners
3mil: public sale
2mil.: private sales
Defi
- Listing on DEX (no KYC, no custody) - JustSwap, Oikos
- Possible liquidity mining for liquidity providers
- Explore other Defi opportunities like lending, borrowing or farming
Cefi
- Partnership with reputable Zizzy Group
- Utilising algo trading strategies and analytics
- Holding 1000 IOI Tokens - 24% APY
- Holding 10 000 IOI Tokens - 36% APY
- Dividend pool share in case of higher profits
Wallet
- Get staking up to 24% APY with IOI tokens
- Purchase cars to increase winning chance
- Holding 1000 IOI - 10 % from dividend pool
- Holding 10 000 IOI Tokens - 90 % from dividend pool
- Access to Never Lose Game
Game
- Play IOI game
- Purchase cars to increase winning chance
- Holding 1000 IOI - 10 % from dividend pool
- Holding 10 000 IOI Tokens - 90 % from dividend pool
- Access to Never Lose Game
Time lock for team
20.12.2021:20% released
20.12.2022: 20% released
20.12.2023: 20% released
20.12.2024: 40% released
60%: Plan to be burned
40%: Future supply
20%: Locked
1%: In circulation
Current IOI token usage
This is a forecast for current 20,000 players on platform
Would you like to earn TOKEN right now! ☞ CLICK HERE
How and Where to Buy Trade Race Manager (IOI)?
You will have to first buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…
We will use Binance Exchange here as it is one of the largest crypto exchanges that accept fiat deposits.
Once you finished the KYC process. You will be asked to add a payment method. Here you can either choose to provide a credit/debit card or use a bank transfer, and buy one of the major cryptocurrencies, usually either Bitcoin (BTC), Ethereum (ETH), Tether (USDT), Binance (BNB)…
Step by Step Guide : What is Binance | How to Create an account on Binance (Updated 2021)
Next step
You need a wallet address to Connect to Uniswap Decentralized Exchange, we use Metamask wallet
If you don’t have a Metamask wallet, read this article and follow the steps
☞What is Metamask wallet | How to Create a wallet and Use
Transfer $ETH to your new Metamask wallet from your existing wallet
Next step
Connect Metamask wallet to Uniswap Decentralized Exchange and Buy, Swap IOI token
Read more: What is Uniswap | Beginner’s Guide on How to Use Uniswap
SINCE 10 MAY
Ticker: IOI
Token type: ERC20 ICO
Token Price: 1 IOI = 0.40 USD
Fundraising Goal: 500,000 TOKEN
**Total Tokens: **50,000,000
**Available for Token Sale: **10%
There are a few popular crypto exchanges where they have decent daily trading volumes and a huge user base. This will ensure you will be able to sell your coins at any time and the fees will usually be lower. It is suggested that you also register on these exchanges since once IOI gets listed there it will attract a large amount of trading volumes from the users there, that means you will be having some great trading opportunities!
Top exchanges for token-coin trading. Follow instructions and make unlimited money
☞ https://www.binance.com
☞ https://www.bittrex.com
☞ https://www.poloniex.com
☞ https://www.bitfinex.com
☞ https://www.huobi.com
Find more information IOI
☞ Website ☞ Announcement ☞ Social Channel ☞ Social Channel 2 ☞ Social Channel 3 ☞ Message Board ☞ Message Board 2 ☞ Tokenometrics ☞ Sales Details
🔺DISCLAIMER: The Information in the post isn’t financial advice, is intended FOR GENERAL INFORMATION PURPOSES ONLY. Trading Cryptocurrency is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money.
🔥 If you’re a beginner. I believe the article below will be useful to you
⭐ ⭐ ⭐ What You Should Know Before Investing in Cryptocurrency - For Beginner ⭐ ⭐ ⭐
I hope this post will help you. Don’t forget to leave a like, comment and sharing it with others. Thank you!
#blockchain #bitcoin #ioi #trade race manager
1616572311
Originscale Order Management System
Originscale order management software helps to manage all your orders across channels in a single place. Originscale collects orders across multiple channels in real-time - online, offline, D2C, B2B, and more. View all your orders in one single window and process them with a simple click.
#order management system #ordering management system #order management software #free order management software #purchase order management software #best order management software
1659601560
Words Counted: A Ruby Natural Language Processor.
WordsCounted
We are all in the gutter, but some of us are looking at the stars.
-- Oscar Wilde
WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.
Are you using WordsCounted to do something interesting? Please tell me about it.
Demo
Visit this website for one example of what you can do with WordsCounted.
Features
- Out of the box, get the following data from any string or readable file, or URL:
- Token count and unique token count
- Token densities, frequencies, and lengths
- Char count and average chars per token
- The longest tokens and their lengths
- The most frequent tokens and their frequencies.
- A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
- Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as
["Bayrūt"]and not["Bayr", "ū", "t"], for example. - Opens and reads files. Pass in a file path or a url instead of a string.
Installation
Add this line to your application's Gemfile:
gem 'words_counted'
And then execute:
$ bundle
Or install it yourself as:
$ gem install words_counted
Usage
Pass in a string or a file path, and an optional filter and/or regexp.
counter = WordsCounted.count(
"We are all in the gutter, but some of us are looking at the stars."
)
# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")
.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.
API
WordsCounted
WordsCounted.count(input, options = {})
Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.
counter = WordsCounted.count("Hello Beirut!")
Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.
WordsCounted.from_file(path, options = {})
Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.
counter = WordsCounted.from_file("hello_beirut.txt")
Accepts the same options as .count.
Tokeniser
The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.
Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.
#tokenise([pattern: TOKEN_REGEXP, exclude: nil])
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise
# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")
# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)
See Excluding tokens from the analyser and Passing in a custom regexp for more information.
Counter
The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.
#token_count
Returns the token count of a given string.
counter.token_count #=> 15
#token_frequency
Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.
counter.token_frequency
[
["the", 2],
["are", 2],
["we", 1],
# ...
["all", 1]
]
#most_frequent_tokens
Returns a hash where each key-value pair is a token and its frequency.
counter.most_frequent_tokens
{ "are" => 2, "the" => 2 }
#token_lengths
Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.
counter.token_lengths
[
["looking", 7],
["gutter", 6],
["stars", 5],
# ...
["in", 2]
]
#longest_tokens
Returns a hash where each key-value pair is a token and its length.
counter.longest_tokens
{ "looking" => 7 }
#token_density([ precision: 2 ])
Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.
counter.token_density
[
["are", 0.13],
["the", 0.13],
["but", 0.07 ],
# ...
["we", 0.07 ]
]
#char_count
Returns the char count of tokens.
counter.char_count #=> 76
#average_chars_per_token([ precision: 2 ])
Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.
counter.average_chars_per_token #=> 4
#uniq_token_count
Returns the number of unique tokens.
counter.uniq_token_count #=> 13
Excluding tokens from the tokeniser
You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.
- A space-delimited string. The filter will normalise the string.
- A regular expression.
- A lambda.
- A symbol that names a predicate method. For example
:odd?. - An array of any combination of the above.
tokeniser =
WordsCounted::Tokeniser.new(
"Magnificent! That was magnificent, Trevor."
)
# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]
# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]
# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]
# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]
# Using an array
tokeniser = WordsCounted::Tokeniser.new(
"Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]
Passing in a custom regexp
The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.
/[\p{Alpha}\-']+/
You can pass your own criteria as a Ruby regular expression to split your string as desired.
For example, if you wanted to include numbers, you can override the regular expression:
counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]
Opening and reading files
Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.
counter = WordsCounted.from_file("url/or/path/to/file.text")
Gotchas
A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.
counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency
[
["do", 2],
["how", 1],
["you", 1],
["-you", 1], # WTF, mate!
["are", 1],
# ...
]
In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.
A note on case sensitivity
The program will normalise (downcase) all incoming strings for consistency and filters.
Roadmap
Ability to open URLs
def self.from_url
# open url and send string here after removing html
end
Contributors
See contributors.
Contributing
- Fork it
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Add some feature') - Push to the branch (
git push origin my-new-feature) - Create new Pull Request
Author: abitdodgy
Source code: https://github.com/abitdodgy/words_counted
License: MIT license
#ruby #ruby-on-rails
1658068560
WordsCounted: A Ruby Natural Language Processor
WordsCounted
We are all in the gutter, but some of us are looking at the stars.
-- Oscar Wilde
WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.
Features
- Out of the box, get the following data from any string or readable file, or URL:
- Token count and unique token count
- Token densities, frequencies, and lengths
- Char count and average chars per token
- The longest tokens and their lengths
- The most frequent tokens and their frequencies.
- A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
- Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as
["Bayrūt"]and not["Bayr", "ū", "t"], for example. - Opens and reads files. Pass in a file path or a url instead of a string.
Installation
Add this line to your application's Gemfile:
gem 'words_counted'
And then execute:
$ bundle
Or install it yourself as:
$ gem install words_counted
Usage
Pass in a string or a file path, and an optional filter and/or regexp.
counter = WordsCounted.count(
"We are all in the gutter, but some of us are looking at the stars."
)
# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")
.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.
API
WordsCounted
WordsCounted.count(input, options = {})
Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.
counter = WordsCounted.count("Hello Beirut!")
Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.
WordsCounted.from_file(path, options = {})
Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.
counter = WordsCounted.from_file("hello_beirut.txt")
Accepts the same options as .count.
Tokeniser
The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.
Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.
#tokenise([pattern: TOKEN_REGEXP, exclude: nil])
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise
# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")
# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)
See Excluding tokens from the analyser and Passing in a custom regexp for more information.
Counter
The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.
#token_count
Returns the token count of a given string.
counter.token_count #=> 15
#token_frequency
Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.
counter.token_frequency
[
["the", 2],
["are", 2],
["we", 1],
# ...
["all", 1]
]
#most_frequent_tokens
Returns a hash where each key-value pair is a token and its frequency.
counter.most_frequent_tokens
{ "are" => 2, "the" => 2 }
#token_lengths
Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.
counter.token_lengths
[
["looking", 7],
["gutter", 6],
["stars", 5],
# ...
["in", 2]
]
#longest_tokens
Returns a hash where each key-value pair is a token and its length.
counter.longest_tokens
{ "looking" => 7 }
#token_density([ precision: 2 ])
Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.
counter.token_density
[
["are", 0.13],
["the", 0.13],
["but", 0.07 ],
# ...
["we", 0.07 ]
]
#char_count
Returns the char count of tokens.
counter.char_count #=> 76
#average_chars_per_token([ precision: 2 ])
Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.
counter.average_chars_per_token #=> 4
#uniq_token_count
Returns the number of unique tokens.
counter.uniq_token_count #=> 13
Excluding tokens from the tokeniser
You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.
- A space-delimited string. The filter will normalise the string.
- A regular expression.
- A lambda.
- A symbol that names a predicate method. For example
:odd?. - An array of any combination of the above.
tokeniser =
WordsCounted::Tokeniser.new(
"Magnificent! That was magnificent, Trevor."
)
# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]
# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]
# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]
# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]
# Using an array
tokeniser = WordsCounted::Tokeniser.new(
"Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]
Passing in a custom regexp
The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.
/[\p{Alpha}\-']+/
You can pass your own criteria as a Ruby regular expression to split your string as desired.
For example, if you wanted to include numbers, you can override the regular expression:
counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]
Opening and reading files
Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.
counter = WordsCounted.from_file("url/or/path/to/file.text")
Gotchas
A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.
counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency
[
["do", 2],
["how", 1],
["you", 1],
["-you", 1], # WTF, mate!
["are", 1],
# ...
]
In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.
A note on case sensitivity
The program will normalise (downcase) all incoming strings for consistency and filters.
Roadmap
Ability to open URLs
def self.from_url
# open url and send string here after removing html
end
Are you using WordsCounted to do something interesting? Please tell me about it.
Demo
Visit this website for one example of what you can do with WordsCounted.
Contributors
See contributors.
Contributing
- Fork it
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Add some feature') - Push to the branch (
git push origin my-new-feature) - Create new Pull Request
Author: Abitdodgy
Source Code: https://github.com/abitdodgy/words_counted
License: MIT license
1604379605
Digital Assets Management Software Solution | AI-based Assets Management System
A Digital Asset Management System makes it easier to store, manage, and share all of your digital assets on cloud-based storage.
We help you to build Digital Asset Management (DAM) systems with your precise business requirements, whether you want one for maintaining management, production management, brand management systems, or implementing with your sales department with the digital assets it needs.
To learn more about how the Digital Asset Management system will help your business, email us at hello@techavidus.com
#digital assets management #assets management solution #digital asset management system #production management #brand management