What is DeXe Network (DEXE) | What is DeXe Network token |What is DEXE token

The DeXe token (DEXE) claims to enable the open and permissionless system. Following protocol rules and contributing resources facilitates consensus between participants. The token has two vital functions:

(1) Automatic buyback and distribution among insurance vault, farming rewards among token holders and burning of tokens for a % of traders’ rewards.

(2) Participation in DeXe DAO. It is not required to be a DEXE token holder to participate in DeXe.network and benefit from the several of its social trading functions. Moreover, DeXe is uploading DEXE smart contract into the open-source community which is free speech and is the fundamental tenants of its Memorandum. However, in order to be able to fully participate in the community, receive the voting right, contribute through proposals and benefit from the incentives inside the network, basically, to become the member of DAO, users are required to acquire DEXE.

Image for post

Dexe.network or Dexe is a decentralized social trading platform designed to copy the best traders strategies.

With the development of decentralized finance technologies, new products are emerging.

Here is one of them. It is a very useful tool for both traders. So it is for investors.

Image for post

It’s a unique product creating a one-of-a-kind copy trading tool in the DeFi environment.

Our team has been developing this product since 2019 using all experience and industry standards of trading. During this time, we managed to reach a key goal — the creation of an easy-to-use product for decentralized copying of the best traders.

How does it work?

We have implemented 2 types of user’s experience.

1. When the user can simply copy the wallet via the DeXe interface on the platform.

2. When the user can check the statistics and rating, select the desired trader and through the DeXe network smart contract start copying.

The user doesn’t experience difficulties in both cases. He/She should only have a desktop or smartphone wallet (for example, MetaMask or Trust Wallet).

Let’s look at the second case in more detail. When the user invests in a DeXe smart contract, the system issues a token of this trader that is equal to the value of the invested assets by the user. In this case, the Trader trades with the user’s investments, on the other hand, the user has the trader’s token, which he can hold in his wallet, send to another address, donate, etc. The trader, after a certain period of time, increases the volume of traded funds so the user’s token value also increases. Voluntary, the user transfers this token to the DeXe smart contract and receives the asset and the profit earned by the trader in return.

DeFi lacks decentralized asset management

The DeFi ecosystem shows unheard-of growth rates. According to the Defi Pulse resources, at the moment, the volume of Locked USD in DeFi has increased more than ten times this past year to reach USD 7B. This environment gave birth to decentralized banks and various projects in lending and borrowing, insurance, tokenization of assets, etc. However, it is still lacking tools for decentralized capital management. Our DeXe network is designed to fill this void with a decentralized social trading product.

Dexe.network operates on the DAO (decentralized autonomous organization) principles. It means that any user within this network fully controls all financial transactions going through a personal wallet. No third parties interfere in the process.

The necessity of such a secure and decentralized money management tool is undeniable. Dexe provides an opportunity for any user to invest safely in a decentralized environment, controlling risks and finances using just the his/hers wallet.

Ready to start, we need feedback

Our community will be composed of network members who will take important structural positions in the network as it grows and develops. To enjoy the Dexe project numerous opportunities, join our community, and be the first to hear our hottest news.

Dexe is already operating in a trial mode, and we’ll become public soon! Stay tuned!

Subscribe to our social networks to be the first one to know about the public release and provide feedback and questions:

Image for post

As promised, DeXe.network is presenting the details of the upcoming token sale.

This is an important moment for the DeXe.network ecosystem and the pass for the fairest and most honest way to attract the most interested community members to build a decentralized permissionless DeXe.network ecosystem, this event will give the platform growth and the ability to scale.

DeXe.network wants you to take time to familiarize yourself with all the provided information, and receive valued/important feedback.

TOKEN SALE DETAILS

Image for post

Everyone will be able to participate in the token sale, and everyone will have the chance to choose the most interesting screenplay.

DeXe.network would like to note that the structure of the token sale is very specific, a large number of details have been calculated mathematically, and the token sale itself will allow all the interested users to understand how the product works and what benefits can be obtained using the DeXe.network platform.

Moreover, for all participants who, for various reasons, will not be able to take part in the token sale, but want to be part of the community, several interesting activities will be held where participants will be rewarded with tokens of DeXe.network ecosystem.

The date of the token sale will be announced soon, stay tuned!

Image for post

Dear community, we are glad to tell more details about the DeXe Utility token, and today we are satisfied to declare that the first round of the token sale will start on September 28, 2020.

The structure of the project’ token sale is quite complicated, so each of you have to comprehend the subtleties so as to settle on an educated choice and pick your own strategy.

Let’s start with the main thing:

The token sale will occur on the DeXe autonomous smart contract, we will inform you regarding its features and a detailed description of its work soon.

1. Using the DeXe Utility token in the ecosystem:

1.1 Programmed redemption and burning of tokens for a certain % of the traders’ compensation.

1.2 Control over DeXe treasury better. One of the DeXe functionality includes farming rewards with DeXe.network from social trading activity.

1.3 Use of the token by the holders for casting a ballot and settling on choices regarding:

a. The timespan and adjustment of the percentage of tokens burned.

b. Effect on the number of remunerations got for farming (increase or decline the percent of accrual)

c. Voting for the date of burning tokens and ascertaining the reward for farming (details below).

1.4 Work of the system for insuring users’ deposits by staking tokens on DEX.

2. Token metrics:

Token name — Dexe

Ticker — DEXE

Token type — ERC20

Token price — formed by the first round, based on funding.

For instance, if the aggregate sum of funds gathered in the first round was $ 500,000, at that point we isolate this sum by the quantity of tokens allocated for the first round — 1,000,000, subsequently we get the base cost of the token $ 0.5

The total number of tokens is 100,000,000 DEXE

Initial circulation after 22 rounds — from 2,000,000 to 6,000,000 DEXE (depends on the number of tokens that will be sold or burned during the sale)

Accepted in USDC, USDT and ETH

Circulating offer after 22 rounds — from 2,000,000 to 6,000,000 DEXE (depends on the quantity of tokens that will be sold or burned during the sale)

Each participant will have the option to deposit the sum that he wants. At the end of the round, all participants will get tokens in proportion to their contribution, contingent upon the formed token price on the DEX in this round.

3. Distribution of tokens:

● Public sale — 5%

● Staking rewards — up to 10%.

● Fund — 33%

● Team — 20%

● Partnership and ecosystem — 16%.

● School of trading and competition — 10%

● Marketing — 5%

● Market liquidity fund — 1%

4. Token lock and release:

● Public token sale — no lock

● Awards for staking — vesting for 12 months.

● Foundation — lock for 1 year, with vesting for 48 months.

● Team — 6 months lock, vesting for 24 months.

● Partners and ecosystem — 3 months of lock, vesting for 12 months

● School of trading and competition — 2 months of lock, 12 months of allotment.

● Marketing — lock for 1 month, vesting for 12 months

● Market liquidity fund — no lock

Sale duration is 22 days, where 1 round continues 24 hours.

Participants of the rounds will receive daily dynamic staking rewards when they holding DEXE tokens.

Details

After every finished round of the token sale, participants have to claim their DeXe tokens.

Since the goal of the DeXe team is not to raise funds, but to create a strong ecosystem and a reliable, informed community, the first round is strategic. Long term partners, and those users, who can bring the greatest value to the product can participate in it. After the launch they will become the first large clients.

Fill out the application form of the first token sale round participants and we will consider it.

Application form

In the first round, the largest possible amount of tokens that could be sold is 20% — 1,000,000. For each ensuing cycle, 190,476 tokens will be allocated.

Additionally, each participant of the sale is allowed to turn into a member of the Dynamic Staking rewards program. You simply need to keep the tokens in your wallet during the sale period. If the user buys tokens in addition in subsequent rounds by at least 1% or more (of the total number of tokens he has bought before), he will receive х2 Staking rewards.

Would you like to earn DEXE right now! ☞ CLICK HERE

Looking for more information…

☞ Website
☞ Explorer
☞ Whitepaper
☞ Social Channel
Message Board
☞ Documentation
☞ Coinmarketcap

Thank for visiting and reading this article! I’m highly appreciate your actions! Please share if you liked it!

#cryptocurrency #bitcoin #dexe network #dexe

What is GEEK

Buddha Community

What is DeXe Network (DEXE) | What is DeXe Network token |What is DEXE token

What is DeXe Network (DEXE) | What is DeXe Network token |What is DEXE token

The DeXe token (DEXE) claims to enable the open and permissionless system. Following protocol rules and contributing resources facilitates consensus between participants. The token has two vital functions:

(1) Automatic buyback and distribution among insurance vault, farming rewards among token holders and burning of tokens for a % of traders’ rewards.

(2) Participation in DeXe DAO. It is not required to be a DEXE token holder to participate in DeXe.network and benefit from the several of its social trading functions. Moreover, DeXe is uploading DEXE smart contract into the open-source community which is free speech and is the fundamental tenants of its Memorandum. However, in order to be able to fully participate in the community, receive the voting right, contribute through proposals and benefit from the incentives inside the network, basically, to become the member of DAO, users are required to acquire DEXE.

Image for post

Dexe.network or Dexe is a decentralized social trading platform designed to copy the best traders strategies.

With the development of decentralized finance technologies, new products are emerging.

Here is one of them. It is a very useful tool for both traders. So it is for investors.

Image for post

It’s a unique product creating a one-of-a-kind copy trading tool in the DeFi environment.

Our team has been developing this product since 2019 using all experience and industry standards of trading. During this time, we managed to reach a key goal — the creation of an easy-to-use product for decentralized copying of the best traders.

How does it work?

We have implemented 2 types of user’s experience.

1. When the user can simply copy the wallet via the DeXe interface on the platform.

2. When the user can check the statistics and rating, select the desired trader and through the DeXe network smart contract start copying.

The user doesn’t experience difficulties in both cases. He/She should only have a desktop or smartphone wallet (for example, MetaMask or Trust Wallet).

Let’s look at the second case in more detail. When the user invests in a DeXe smart contract, the system issues a token of this trader that is equal to the value of the invested assets by the user. In this case, the Trader trades with the user’s investments, on the other hand, the user has the trader’s token, which he can hold in his wallet, send to another address, donate, etc. The trader, after a certain period of time, increases the volume of traded funds so the user’s token value also increases. Voluntary, the user transfers this token to the DeXe smart contract and receives the asset and the profit earned by the trader in return.

DeFi lacks decentralized asset management

The DeFi ecosystem shows unheard-of growth rates. According to the Defi Pulse resources, at the moment, the volume of Locked USD in DeFi has increased more than ten times this past year to reach USD 7B. This environment gave birth to decentralized banks and various projects in lending and borrowing, insurance, tokenization of assets, etc. However, it is still lacking tools for decentralized capital management. Our DeXe network is designed to fill this void with a decentralized social trading product.

Dexe.network operates on the DAO (decentralized autonomous organization) principles. It means that any user within this network fully controls all financial transactions going through a personal wallet. No third parties interfere in the process.

The necessity of such a secure and decentralized money management tool is undeniable. Dexe provides an opportunity for any user to invest safely in a decentralized environment, controlling risks and finances using just the his/hers wallet.

Ready to start, we need feedback

Our community will be composed of network members who will take important structural positions in the network as it grows and develops. To enjoy the Dexe project numerous opportunities, join our community, and be the first to hear our hottest news.

Dexe is already operating in a trial mode, and we’ll become public soon! Stay tuned!

Subscribe to our social networks to be the first one to know about the public release and provide feedback and questions:

Image for post

As promised, DeXe.network is presenting the details of the upcoming token sale.

This is an important moment for the DeXe.network ecosystem and the pass for the fairest and most honest way to attract the most interested community members to build a decentralized permissionless DeXe.network ecosystem, this event will give the platform growth and the ability to scale.

DeXe.network wants you to take time to familiarize yourself with all the provided information, and receive valued/important feedback.

TOKEN SALE DETAILS

Image for post

Everyone will be able to participate in the token sale, and everyone will have the chance to choose the most interesting screenplay.

DeXe.network would like to note that the structure of the token sale is very specific, a large number of details have been calculated mathematically, and the token sale itself will allow all the interested users to understand how the product works and what benefits can be obtained using the DeXe.network platform.

Moreover, for all participants who, for various reasons, will not be able to take part in the token sale, but want to be part of the community, several interesting activities will be held where participants will be rewarded with tokens of DeXe.network ecosystem.

The date of the token sale will be announced soon, stay tuned!

Image for post

Dear community, we are glad to tell more details about the DeXe Utility token, and today we are satisfied to declare that the first round of the token sale will start on September 28, 2020.

The structure of the project’ token sale is quite complicated, so each of you have to comprehend the subtleties so as to settle on an educated choice and pick your own strategy.

Let’s start with the main thing:

The token sale will occur on the DeXe autonomous smart contract, we will inform you regarding its features and a detailed description of its work soon.

1. Using the DeXe Utility token in the ecosystem:

1.1 Programmed redemption and burning of tokens for a certain % of the traders’ compensation.

1.2 Control over DeXe treasury better. One of the DeXe functionality includes farming rewards with DeXe.network from social trading activity.

1.3 Use of the token by the holders for casting a ballot and settling on choices regarding:

a. The timespan and adjustment of the percentage of tokens burned.

b. Effect on the number of remunerations got for farming (increase or decline the percent of accrual)

c. Voting for the date of burning tokens and ascertaining the reward for farming (details below).

1.4 Work of the system for insuring users’ deposits by staking tokens on DEX.

2. Token metrics:

Token name — Dexe

Ticker — DEXE

Token type — ERC20

Token price — formed by the first round, based on funding.

For instance, if the aggregate sum of funds gathered in the first round was $ 500,000, at that point we isolate this sum by the quantity of tokens allocated for the first round — 1,000,000, subsequently we get the base cost of the token $ 0.5

The total number of tokens is 100,000,000 DEXE

Initial circulation after 22 rounds — from 2,000,000 to 6,000,000 DEXE (depends on the number of tokens that will be sold or burned during the sale)

Accepted in USDC, USDT and ETH

Circulating offer after 22 rounds — from 2,000,000 to 6,000,000 DEXE (depends on the quantity of tokens that will be sold or burned during the sale)

Each participant will have the option to deposit the sum that he wants. At the end of the round, all participants will get tokens in proportion to their contribution, contingent upon the formed token price on the DEX in this round.

3. Distribution of tokens:

● Public sale — 5%

● Staking rewards — up to 10%.

● Fund — 33%

● Team — 20%

● Partnership and ecosystem — 16%.

● School of trading and competition — 10%

● Marketing — 5%

● Market liquidity fund — 1%

4. Token lock and release:

● Public token sale — no lock

● Awards for staking — vesting for 12 months.

● Foundation — lock for 1 year, with vesting for 48 months.

● Team — 6 months lock, vesting for 24 months.

● Partners and ecosystem — 3 months of lock, vesting for 12 months

● School of trading and competition — 2 months of lock, 12 months of allotment.

● Marketing — lock for 1 month, vesting for 12 months

● Market liquidity fund — no lock

Sale duration is 22 days, where 1 round continues 24 hours.

Participants of the rounds will receive daily dynamic staking rewards when they holding DEXE tokens.

Details

After every finished round of the token sale, participants have to claim their DeXe tokens.

Since the goal of the DeXe team is not to raise funds, but to create a strong ecosystem and a reliable, informed community, the first round is strategic. Long term partners, and those users, who can bring the greatest value to the product can participate in it. After the launch they will become the first large clients.

Fill out the application form of the first token sale round participants and we will consider it.

Application form

In the first round, the largest possible amount of tokens that could be sold is 20% — 1,000,000. For each ensuing cycle, 190,476 tokens will be allocated.

Additionally, each participant of the sale is allowed to turn into a member of the Dynamic Staking rewards program. You simply need to keep the tokens in your wallet during the sale period. If the user buys tokens in addition in subsequent rounds by at least 1% or more (of the total number of tokens he has bought before), he will receive х2 Staking rewards.

Would you like to earn DEXE right now! ☞ CLICK HERE

Looking for more information…

☞ Website
☞ Explorer
☞ Whitepaper
☞ Social Channel
Message Board
☞ Documentation
☞ Coinmarketcap

Thank for visiting and reading this article! I’m highly appreciate your actions! Please share if you liked it!

#cryptocurrency #bitcoin #dexe network #dexe

Words Counted: A Ruby Natural Language Processor.

WordsCounted

We are all in the gutter, but some of us are looking at the stars.

-- Oscar Wilde

WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.

Are you using WordsCounted to do something interesting? Please tell me about it.

 

Demo

Visit this website for one example of what you can do with WordsCounted.

Features

  • Out of the box, get the following data from any string or readable file, or URL:
    • Token count and unique token count
    • Token densities, frequencies, and lengths
    • Char count and average chars per token
    • The longest tokens and their lengths
    • The most frequent tokens and their frequencies.
  • A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
  • Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as ["Bayrūt"] and not ["Bayr", "ū", "t"], for example.
  • Opens and reads files. Pass in a file path or a url instead of a string.

Installation

Add this line to your application's Gemfile:

gem 'words_counted'

And then execute:

$ bundle

Or install it yourself as:

$ gem install words_counted

Usage

Pass in a string or a file path, and an optional filter and/or regexp.

counter = WordsCounted.count(
  "We are all in the gutter, but some of us are looking at the stars."
)

# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")

.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.

API

WordsCounted

WordsCounted.count(input, options = {})

Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.count("Hello Beirut!")

Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.

WordsCounted.from_file(path, options = {})

Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.from_file("hello_beirut.txt")

Accepts the same options as .count.

Tokeniser

The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.

Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.

#tokenise([pattern: TOKEN_REGEXP, exclude: nil])

tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise

# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")

# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)

See Excluding tokens from the analyser and Passing in a custom regexp for more information.

Counter

The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.

#token_count

Returns the token count of a given string.

counter.token_count #=> 15

#token_frequency

Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.

counter.token_frequency

[
  ["the", 2],
  ["are", 2],
  ["we",  1],
  # ...
  ["all", 1]
]

#most_frequent_tokens

Returns a hash where each key-value pair is a token and its frequency.

counter.most_frequent_tokens

{ "are" => 2, "the" => 2 }

#token_lengths

Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.

counter.token_lengths

[
  ["looking", 7],
  ["gutter",  6],
  ["stars",   5],
  # ...
  ["in",      2]
]

#longest_tokens

Returns a hash where each key-value pair is a token and its length.

counter.longest_tokens

{ "looking" => 7 }

#token_density([ precision: 2 ])

Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.

counter.token_density

[
  ["are",     0.13],
  ["the",     0.13],
  ["but",     0.07 ],
  # ...
  ["we",      0.07 ]
]

#char_count

Returns the char count of tokens.

counter.char_count #=> 76

#average_chars_per_token([ precision: 2 ])

Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.

counter.average_chars_per_token #=> 4

#uniq_token_count

Returns the number of unique tokens.

counter.uniq_token_count #=> 13

Excluding tokens from the tokeniser

You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.

  1. A space-delimited string. The filter will normalise the string.
  2. A regular expression.
  3. A lambda.
  4. A symbol that names a predicate method. For example :odd?.
  5. An array of any combination of the above.
tokeniser =
  WordsCounted::Tokeniser.new(
    "Magnificent! That was magnificent, Trevor."
  )

# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]

# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]

# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]

# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]

# Using an array
tokeniser = WordsCounted::Tokeniser.new(
  "Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
  exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]

Passing in a custom regexp

The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.

/[\p{Alpha}\-']+/

You can pass your own criteria as a Ruby regular expression to split your string as desired.

For example, if you wanted to include numbers, you can override the regular expression:

counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]

Opening and reading files

Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.

counter = WordsCounted.from_file("url/or/path/to/file.text")

Gotchas

A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.

counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency

[
  ["do",   2],
  ["how",  1],
  ["you",  1],
  ["-you", 1], # WTF, mate!
  ["are",  1],
  # ...
]

In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.

A note on case sensitivity

The program will normalise (downcase) all incoming strings for consistency and filters.

Roadmap

Ability to open URLs

def self.from_url
  # open url and send string here after removing html
end

Contributors

See contributors.

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request

Author: abitdodgy
Source code: https://github.com/abitdodgy/words_counted
License: MIT license

#ruby  #ruby-on-rails 

Royce  Reinger

Royce Reinger

1658068560

WordsCounted: A Ruby Natural Language Processor

WordsCounted

We are all in the gutter, but some of us are looking at the stars.

-- Oscar Wilde

WordsCounted is a Ruby NLP (natural language processor). WordsCounted lets you implement powerful tokensation strategies with a very flexible tokeniser class.

Features

  • Out of the box, get the following data from any string or readable file, or URL:
    • Token count and unique token count
    • Token densities, frequencies, and lengths
    • Char count and average chars per token
    • The longest tokens and their lengths
    • The most frequent tokens and their frequencies.
  • A flexible way to exclude tokens from the tokeniser. You can pass a string, regexp, symbol, lambda, or an array of any combination of those types for powerful tokenisation strategies.
  • Pass your own regexp rules to the tokeniser if you prefer. The default regexp filters special characters but keeps hyphens and apostrophes. It also plays nicely with diacritics (UTF and unicode characters): Bayrūt is treated as ["Bayrūt"] and not ["Bayr", "ū", "t"], for example.
  • Opens and reads files. Pass in a file path or a url instead of a string.

Installation

Add this line to your application's Gemfile:

gem 'words_counted'

And then execute:

$ bundle

Or install it yourself as:

$ gem install words_counted

Usage

Pass in a string or a file path, and an optional filter and/or regexp.

counter = WordsCounted.count(
  "We are all in the gutter, but some of us are looking at the stars."
)

# Using a file
counter = WordsCounted.from_file("path/or/url/to/my/file.txt")

.count and .from_file are convenience methods that take an input, tokenise it, and return an instance of WordsCounted::Counter initialized with the tokens. The WordsCounted::Tokeniser and WordsCounted::Counter classes can be used alone, however.

API

WordsCounted

WordsCounted.count(input, options = {})

Tokenises input and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.count("Hello Beirut!")

Accepts two options: exclude and regexp. See Excluding tokens from the analyser and Passing in a custom regexp respectively.

WordsCounted.from_file(path, options = {})

Reads and tokenises a file, and initializes a WordsCounted::Counter object with the resulting tokens.

counter = WordsCounted.from_file("hello_beirut.txt")

Accepts the same options as .count.

Tokeniser

The tokeniser allows you to tokenise text in a variety of ways. You can pass in your own rules for tokenisation, and apply a powerful filter with any combination of rules as long as they can boil down into a lambda.

Out of the box the tokeniser includes only alpha chars. Hyphenated tokens and tokens with apostrophes are considered a single token.

#tokenise([pattern: TOKEN_REGEXP, exclude: nil])

tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise

# With `exclude`
tokeniser = WordsCounted::Tokeniser.new("Hello Beirut!").tokenise(exclude: "hello")

# With `pattern`
tokeniser = WordsCounted::Tokeniser.new("I <3 Beirut!").tokenise(pattern: /[a-z]/i)

See Excluding tokens from the analyser and Passing in a custom regexp for more information.

Counter

The WordsCounted::Counter class allows you to collect various statistics from an array of tokens.

#token_count

Returns the token count of a given string.

counter.token_count #=> 15

#token_frequency

Returns a sorted (unstable) two-dimensional array where each element is a token and its frequency. The array is sorted by frequency in descending order.

counter.token_frequency

[
  ["the", 2],
  ["are", 2],
  ["we",  1],
  # ...
  ["all", 1]
]

#most_frequent_tokens

Returns a hash where each key-value pair is a token and its frequency.

counter.most_frequent_tokens

{ "are" => 2, "the" => 2 }

#token_lengths

Returns a sorted (unstable) two-dimentional array where each element contains a token and its length. The array is sorted by length in descending order.

counter.token_lengths

[
  ["looking", 7],
  ["gutter",  6],
  ["stars",   5],
  # ...
  ["in",      2]
]

#longest_tokens

Returns a hash where each key-value pair is a token and its length.

counter.longest_tokens

{ "looking" => 7 }

#token_density([ precision: 2 ])

Returns a sorted (unstable) two-dimentional array where each element contains a token and its density as a float, rounded to a precision of two. The array is sorted by density in descending order. It accepts a precision argument, which must be a float.

counter.token_density

[
  ["are",     0.13],
  ["the",     0.13],
  ["but",     0.07 ],
  # ...
  ["we",      0.07 ]
]

#char_count

Returns the char count of tokens.

counter.char_count #=> 76

#average_chars_per_token([ precision: 2 ])

Returns the average char count per token rounded to two decimal places. Accepts a precision argument which defaults to two. Precision must be a float.

counter.average_chars_per_token #=> 4

#uniq_token_count

Returns the number of unique tokens.

counter.uniq_token_count #=> 13

Excluding tokens from the tokeniser

You can exclude anything you want from the input by passing the exclude option. The exclude option accepts a variety of filters and is extremely flexible.

  1. A space-delimited string. The filter will normalise the string.
  2. A regular expression.
  3. A lambda.
  4. A symbol that names a predicate method. For example :odd?.
  5. An array of any combination of the above.
tokeniser =
  WordsCounted::Tokeniser.new(
    "Magnificent! That was magnificent, Trevor."
  )

# Using a string
tokeniser.tokenise(exclude: "was magnificent")
# => ["that", "trevor"]

# Using a regular expression
tokeniser.tokenise(exclude: /trevor/)
# => ["magnificent", "that", "was", "magnificent"]

# Using a lambda
tokeniser.tokenise(exclude: ->(t) { t.length < 4 })
# => ["magnificent", "that", "magnificent", "trevor"]

# Using symbol
tokeniser = WordsCounted::Tokeniser.new("Hello! محمد")
tokeniser.tokenise(exclude: :ascii_only?)
# => ["محمد"]

# Using an array
tokeniser = WordsCounted::Tokeniser.new(
  "Hello! اسماءنا هي محمد، كارولينا، سامي، وداني"
)
tokeniser.tokenise(
  exclude: [:ascii_only?, /محمد/, ->(t) { t.length > 6}, "و"]
)
# => ["هي", "سامي", "وداني"]

Passing in a custom regexp

The default regexp accounts for letters, hyphenated tokens, and apostrophes. This means twenty-one is treated as one token. So is Mohamad's.

/[\p{Alpha}\-']+/

You can pass your own criteria as a Ruby regular expression to split your string as desired.

For example, if you wanted to include numbers, you can override the regular expression:

counter = WordsCounted.count("Numbers 1, 2, and 3", pattern: /[\p{Alnum}\-']+/)
counter.tokens
#=> ["numbers", "1", "2", "and", "3"]

Opening and reading files

Use the from_file method to open files. from_file accepts the same options as .count. The file path can be a URL.

counter = WordsCounted.from_file("url/or/path/to/file.text")

Gotchas

A hyphen used in leu of an em or en dash will form part of the token. This affects the tokeniser algorithm.

counter = WordsCounted.count("How do you do?-you are well, I see.")
counter.token_frequency

[
  ["do",   2],
  ["how",  1],
  ["you",  1],
  ["-you", 1], # WTF, mate!
  ["are",  1],
  # ...
]

In this example -you and you are separate tokens. Also, the tokeniser does not include numbers by default. Remember that you can pass your own regular expression if the default behaviour does not fit your needs.

A note on case sensitivity

The program will normalise (downcase) all incoming strings for consistency and filters.

Roadmap

Ability to open URLs

def self.from_url
  # open url and send string here after removing html
end

Are you using WordsCounted to do something interesting? Please tell me about it.

Gem Version 

RubyDoc documentation.

Demo

Visit this website for one example of what you can do with WordsCounted.


Contributors

See contributors.

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request

Author: Abitdodgy
Source Code: https://github.com/abitdodgy/words_counted 
License: MIT license

#ruby #nlp 

Lisa joly

Lisa joly

1624658400

PAID NETWORK Review, Is it worth Investing in? Token Sale Coming Soon !!

Hey guys, in this video I review PAID NETWORK. This is a DeFi project that aims to solve complex legal process using decentralised protocols and DeFi products for 2021.

PAID Network is an ecosystem DAPP that leverages blockchain technology to deliver DeFi powered SMART Agreements to make business exponentially more efficient. We allow users to create their own policy, to ensure they Get PAID.

📺 The video in this post was made by Crypto expat
The origin of the article: https://www.youtube.com/watch?v=ZIU5javfL90
🔺 DISCLAIMER: The article is for information sharing. The content of this video is solely the opinions of the speaker who is not a licensed financial advisor or registered investment advisor. Not investment advice or legal advice.
Cryptocurrency trading is VERY risky. Make sure you understand these risks and that you are responsible for what you do with your money
🔥 If you’re a beginner. I believe the article below will be useful to you ☞ What You Should Know Before Investing in Cryptocurrency - For Beginner
⭐ ⭐ ⭐The project is of interest to the community. Join to Get free ‘GEEK coin’ (GEEKCASH coin)!
☞ **-----CLICK HERE-----**⭐ ⭐ ⭐
Thanks for visiting and watching! Please don’t forget to leave a like, comment and share!

#bitcoin #blockchain #paid network #paid network review #token sale #paid network review, is it worth investing in? token sale coming soon !!

aaron silva

aaron silva

1622197808

SafeMoon Clone | Create A DeFi Token Like SafeMoon | DeFi token like SafeMoon

SafeMoon is a decentralized finance (DeFi) token. This token consists of RFI tokenomics and auto-liquidity generating protocol. A DeFi token like SafeMoon has reached the mainstream standards under the Binance Smart Chain. Its success and popularity have been immense, thus, making the majority of the business firms adopt this style of cryptocurrency as an alternative.

A DeFi token like SafeMoon is almost similar to the other crypto-token, but the only difference being that it charges a 10% transaction fee from the users who sell their tokens, in which 5% of the fee is distributed to the remaining SafeMoon owners. This feature rewards the owners for holding onto their tokens.

Read More @ https://bit.ly/3oFbJoJ

#create a defi token like safemoon #defi token like safemoon #safemoon token #safemoon token clone #defi token