Pspg: Unix Pager Designed for Work with Tables.

pspg - Postgres Pager

Everybody who uses psql uses less pager. It is working well, but there is not any special support for tabular data. I found few projects, but no one was completed for this purpose. I decided to write some small specialized pager for usage as psql pager.

This pager can be used from the following clients command line clients too:

• mysql
• sqlite
• pgcli
• monetdb
• Trino (formerly Presto SQL)
• usql
• sqlcl (for oracle)

Main target

• possibility to freeze first few rows, first few columns
• possibility to sort data by specified numeric column
• possibility to use fancy colors - like mcview or FoxPro - http://okbob.blogspot.com/2019/12/pspg-themes-what-you-use-it.html
• mouse is supported and used
• possibility to copy selected range to clipboard

Video presentation

Screenshots

Options

[pavel@localhost ~]$ pspg --help
pspg is a Unix pager designed for table browsing.

Usage:
  pspg [OPTION] [file]

General options:
  --about                  about authors
  --help                   show this help
  -V, --version            show version
  -f, --file=FILE          open file
  -F, --quit-if-one-screen
                           quit if content is one screen
  --clipboard-app=NUM      specify app used by copy to clipboard (1, 2, 3)
  --interactive            force interactive mode
  --ignore_file_suffix     don't try to deduce format from file suffix
  --ni                     not interactive mode (only for csv and query)
  --no-watch-file          don't watch inotify event of file
  --no-mouse               don't use own mouse handling
  --no-progressive-load    don't use progressive data load
  --no-sigint-search-reset
                           without reset searching on sigint (CTRL C)
  --no-sleep               without waits against flickering
  --no_xterm_mouse_mode    don't use optional xterm mouse mode
  --only-for-tables        use std pager when content is not table
  --on-sigint-exit         exit on sigint(CTRL C or Escape)
  --pgcli-fix              try to fix some pgcli related issues
  --querystream            read queries from stream forever
  --quit-on-f3             exit on F3 like mc viewers
  --rr=ROWNUM              rows reserved for specific purposes
  --stream                 read input forever
  -X, --reprint-on-exit    preserve content after exit

Output format options:
  -a, --ascii              force ascii
  -b, --blackwhite         black-white style
  -s, --style=N            set color style number (0..22)
  --bold-labels            row, column labels use bold font
  --bold-cursor            cursor use bold font
  --border                 type of borders (0..2)
  --double-header          header separator uses double lines
  --force-uniborder        replace ascii borders by unicode borders
  --highlight-odd-rec      highlights odd records (when it is supported by style)
  --hide-header-line       hides header line (between column names and data)
  --ignore-bad-rows        rows with wrong column numbers are ignored
  --null=STRING            STRING used instead NULL

Searching options
  -g --hlite-search, -G --HILITE-SEARCH
                           don't highlight lines for searches
  -i --ignore-case         ignore case in searches that do not contain uppercase
  -I --IGNORE-CASE         ignore case in all searches

Interface options:
  -c, --freezecols=N       freeze N columns (0..9)
  --less-status-bar        status bar like less pager
  --line-numbers           show line number column
  --menu-always            show top bar menu every time
  --no-bars, --no-commandbar, --no-topbar
                           don't show bottom, top bar or both
  --no-cursor              row cursor will be hidden
  --no-last-row-search     don't use the last pattern when starting a new search
  --no-scrollbar           don't show scrollbar
  --no-sound               don't use beep when scroll is not possible
  --tabular-cursor         cursor is visible only when data has table format
  --vertical-cursor        show vertical column cursor

Input format options:
  --csv                    input stream has csv format
  --csv-separator          char used as field separator
  --csv-header [on/off]    specify header line usage
  --skip-columns-like="SPACE SEPARATED STRING LIST"
                           columns with substr in name are ignored
  --tsv                    input stream has tsv format

Watch mode options:
  -q, --query=QUERY        execute query
  -w, --watch time         the query (or read file) is repeated every time (sec)

Connection options
  -d, --dbname=DBNAME      database name
  -h, --host=HOSTNAME      database server host (default: "local socket")
  -p, --port=PORT          database server port (default: "5432")
  -U, --username=USERNAME  database user name
  -W, --password           force password prompt

Debug options:
  --log=FILE               log debug info to file
  --wait=NUM               wait NUM seconds to allow attach from a debugger

pspg shares lot of key commands with less pager or vi editor.

Options can be passed inside env variable PSPG too.

Environment variables

Name	Usage
PSPG	can holds same options like command line
PSPG_CONF	path to configuration file
PSPG_HISTORY	path to file pspg's readline history file

Themes

Code	Name
0	black & white
1	Midnight Commander like
2	FoxPro like
3	Pdmenu like
4	White theme
5	Mutt like
6	PCFand like
7	Green theme
8	Blue theme
9	Word Perfect like
10	Low contrast blue theme
11	Dark cyan/black mode
12	Paradox like
13	dBase IV retro style
14	dBase IV retro style (Magenta labels)
15	Red white theme
16	Simple theme
17	Solarized dark theme
18	Solarized light theme
19	Gruvbox light theme
20	Tao Light theme
21	FlatWhite theme
22	Relational pipes theme
23	Paper Color theme

see http://okbob.blogspot.cz/2017/07/i-hope-so-every-who-uses-psql-uses-less.html

Custom themes

The theme can be customized over base and menu templates referencing the built-in themes. The custom theme file should be saved in directory with pspg configuration. The name of this file should be .pspg_theme_xxx. The custom theme can be selected by command line option --custom-style=name or by command \ctheme name.

Example of custom theme file (named .pspg_theme_mc2 (it can be activated by command \ctheme mc2)):

template = 1
template_menu = 3

background = black, white
data = black, white
label = black, white, italic, bold
border = #000000, white
footer = lightgray, white
cursor_data = blue, white, italic, bold, dim, reverse
cursor_border = blue, blue , italic, bold, dim, reverse
cursor_label = blue, white, italic, bold, dim, reverse
cursor_footer = blue, white, italic, bold, dim, reverse
cursor_bookmark = red, white, italic, bold, dim, reverse
cross_cursor = white, blue, italic, bold
cross_cursor_border = brightblue, blue
status_bar = black, lightgray
title = black, lightgray
scrollbar_arrows = black, white
scrollbar_background = lightgray, white
scrollbar_slider = white, gray

Some keys can be marked by symobol *. Marked keys are used for odd records.

data* = black, lightgray
label* = black, lightgray, italic, bold
border* = #000000, lightgray

template and template_menu set fallback values for any keys not specified in the custom theme. template_menu in particular is currently the only way to customize the F9 menu appearance.

key	customizes
background	Background color
data	Data (non-header or frozen column) text
border	Border color
label	Label (header or frozen column) text
row_number	Line numbers
record_number
selected_area
footer	Results footer (non-tabular e.g. rowcount)
cursor_data	Highlighted data (non-header or frozen column) text
cursor_border	Highlighted border color
cursor_label	Highlighted label (header or frozen column) text
cursor_row_number	Highlighted line numbers
cursor_record_number
cursor_selected_area
cursor_footer	Highlighted results footer (non-tabular e.g. rowcount)
scrollbar_arrows	Scrollbar up and down arrows
scrollbar_background	Scrollbar "empty" background
scrollbar_slider	Scrollbar slider over the background
scrollbar_active_slider	Scrollbar slider grabbed by mouse
title	Results headline (in psql describe commands)
status_bar	Top query and cursor location information
prompt_bar
info_bar	Info text (e.g. "Not found" when searching)
input_bar	Input prompt and text (e.g. search)
error_bar
bookmark
bookmark_border
cursor_bookmark
cross_cursor	Highlighted cell at intersection of horizontal and vertical cursors
cross_cursor_border	Borders at intersection of horizontal and vertical cursors
matched_pattern	Search result match text
matched_pattern_nohl
matched_line	Line containing search result
matched_line_border	Borders in search result line
matched_pattern_cursor	Highlighted search result match text
matched_line_vertical_cursor	Vertically highlighted search result match text
matched_line_vertical_cursor_border	Borders of vertically highlighted cell with search result match
error

ANSI colors Black, Red, Green, Brown, Blue, Magenta, Cyan, LightGray, Gray, BrightRed, BrightGreen, Yellow, BrightBlue, BrightMagenta, BrightCyan, White, and Default will display as your terminal emulator configures them. Alternatively, you can specify hex RGB values #FF00FF.

Styles are any combination of: bold, italic, underline, reverse, standout, dim.

If the format of some key is not correct, then this row is ignored. For debugging of custom theme is good to start pspg with option --log. An information about broken definitions are stored in log file.

Keyboard commands

Key(s)	Command
0, 1, 2, 3, .., 9	freeze first N columns
KEY_UP, k	navigate backward by one line
KEY_DOWN, j	navigate forward by one line
KEY_LEFT, h	scroll to left
KEY_RIGHT, l	scroll to right
Ctrl+KEY_LEFT	scroll one char left
Ctrl+KEY_RIGHT	scroll one char right
Ctrl+Home, g	go to the start of file
Ctrl+End, G	go to the end of file
Alt+l	go to line number
H	go to first line of current window
M	go to half of current window
L	go to end of current window
PPAGE, Ctrl+b	backward one window
NPAGE, Ctrl+f, space	forward one window
HOME, ^	go to begin of line, first column
END, $	go to end of line, last column
Ctrl+e	scroll a window down
Ctrl+y	scroll a window up
Ctrl+d	forward a half window
Ctrl+u	backward a half window
s	save content to file
/	search for a pattern which will take you to the next occurrence
?	search for a pattern which will take you to the previous occurrence
n	for next match
N	for next match in reverse direction
c	column search
Alt+/	search for a pattern inside selected area
Alt+?	backward search for a pattern inside selected area
Alt+c	switch (on, off) drawing line cursor
Alt+m	switch (on, off) own mouse handler
Alt+n	switch (on, off) drawing line numbers
Alt+v, double click on column header	switch (on, off) drawing column cursor
Mouse button wheel	scroll vertical
Alt+Mouse button wheel	scroll horizontal
F9	show menu
q, F10, Esc 0	quit
Alt+q	quit and print raw (unformatted) content
Alt+k, Alt+double click	switch bookmark
Alt+j	go to next bookmark
Alt+i	go to previous bookmark
Alt+o	flush bookmarks
a	sort ascendent
d	sort descendent
u	unsorted (sorted in origin order)
space	stop/continue in watch mode
R	Repaint screen and refresh input file
Ins	export row, column or cell to default target
shift+cursor...	define range
F3	start/finish of selection rows
shift+F3	start/finish of selection block
Ctrl+drag mouse	defines rows selection, on column header defines column selection
Ctrl+o	show primary screen, press any key to return to pager again

Backslash commands

Command	Description
\N	go to line number
\+N	go to N lines forward
\-N	go to N lines backward
\N+	go to line number
\N-	go to line number from end
\theme N	set theme number
\copy [all|selected] [nullstr "str"] [csv|tsv|insert|text|pipesep|sqlvalues]	copy data to clipboard
\save [all|selected] [nullstr "str"] [csv|tsv|insert|text|pipesep|sqlvalues]	copy data to clipboard
\order [N|colum name]	sort by colum
\orderd [N|colum name]	desc sort by column
\sort [N|colum name]	sort by colum
\sortd [N|colum name]	desc sort by column
\dsort [N|colum name]	desc sort by column (alias)
\rsort [N|colum name]	desc sort by column (alias)
\search [back] [selected] [colum name] [string|"string"]	search string in data

\sort relname

The output can be redirected to any command when the name starts with pipe symbol:

\copy csv | less

Ending

The pager can be ended by pressing keys q or F10 or Esc 0. With option --on-sigint-exit then the pager is closed by pressing keys Ctrl+c or Esc Esc.

Column search

Column search is case insensitive every time. Searched column is marked by vertical cursor. Last non empty string searching pattern is used when current searching pattern is empty string. Searching is starting after visible vertical column or on first visible not freezed columns (after some horizontal scrolling) or on first column. After last column searching starts from first again.

Export & Clipboard

For clipboard support the clipboard application should be installed: 1. wl-clipboard (Wayland), 2. xlip (xwindows) or 3. pbcopy (MacOS).

pspg try to translate unicode symbol '∅' to NULL every time. If you don't use special setting by \pset null ..., then psql displays empty string instead NULL. pspg hasn't any special detection (in export routines) for this case. You should to check and enable or disable menu item Empty string is NULL.

pspg has automatic detection of clipboard application. Unfortunatelly, this detection should not to work for same cases. You can specify the application by specify number (1,2,3) to --clipboard-app option.

Status line description

• V: [d/d d..d] - vertical cursor: (column number)/(columns) (char possitions from) .. (char possitions to)
• FC: d - freezed columns length in chars
• C: d..d/d - unfreezed visible data in chars (from .. to)/(total)
• L:[d + d d/d] - lines (number of first visible line) + (number of line of display), (current line)/(lines)
• d% - percent of already displayed data

Usage as csv viewer

It works well with miller http://johnkerl.org/miller/doc/index.html

mlr --icsv --opprint --barred put '' obce.csv | pspg --force-uniborder

New version has integrated csv support - just use --csv option.

It can be integrated into mc

• copy file from /etc/mc/mc.ext to your ~/.config/mc directory
• insert there

#csv

regex/\.csv
    View=pspg -f %f --csv

• restart mc

Known issues

• When you use pspg on Cygwin, then some temporary freezing of scrolling was reported In this case, please, use an option --no-sleep. I see slow scrolling (via scrollbar) inside konsole (KDE terminal). The option --no-sleep helps too.

Usage in watch mode

The result of query can be refreshed every n seconds. pspg remembers cursor row, possible vertical cursor, possible ordering. The refreshing should be paused by pressing space key. Repeated pressing of this key enables refreshing again.

pspg uses inotify API when it is available, and when input file is changed, then pspg reread file immediately. This behave can be disabled by option --no-watch-file or by specification watch time by option --watch.

Streaming modes

pspg can read a continuous stream of tabular data from pipe, named pipe or from file (with an option --stream or it can read a stream of queries from pipe or from file (with an option --querystream). In stream mode, only data in table format can be processed, because pspg uses empty line as separator between tables.

The query stream mode is an sequence of SQL statements separated by char GS (Group separator - 0x1D on separated line.

Recommended psql configuration

you should to add to your profile:

#for Postgres 10 and older
export PAGER="pspg"

#for postgres 11 and newer
export PSQL_PAGER="pspg"

#or "\setenv PAGER pspg" to .psqlrc

and .psqlrc

\set QUIET 1
\pset linestyle unicode
\pset border 2
\pset null ∅
\unset QUIET

some possible configuration:

-- Switch pagers with :x and :xx commands
\set x '\\setenv PAGER less'
\set xx '\\setenv PAGER \'pspg -bX --no-mouse\''
:xx

LC_CTYPE should be correct. Mainly when you use unicode borders. ncurses doesn't display unicode borders (produced by psql) without correct setting of this variable. Is possible to check a value 'C.UTF8'.

Attention

When you use a option --only-for-tables, then

• set PAGER to pspg and PSQL_PAGER to less or
• set PAGER to less and PSQL_PAGER to pspg

MySQL usage

MariaDB [sakila]> pager pspg -s 14 -X --force-uniborder --quit-if-one-screen
PAGER set to 'pspg -s 14 -X --force-uniborder --quit-if-one-screen'
MariaDB [sakila]> select now();
MariaDB [sakila]> select * from nicer_but_slower_film_list limit 100;

SQLite

SQLite native client doesn't produce well formatted output, but can be forced to generate CSV format - and this format is well readable for pspg

sqlite3 -csv -header testdb.db 'select * from foo2' | pspg --csv --csv-header=on --double-header

pgcli

pgcli needs the following configuration options (~/.config/pgcli/config):

pager = /usr/bin/pspg --csv --rr=2 --quit-if-one-screen --ignore-case --csv-header on --pgcli-fix
table_format = csv

Older version of pgcli had very slow output in tabular format. An workaround was using csv format. This should not be necessary on current versions when the performance issue was fixed. An option --pgcli-fix fixed import of partially broken csv format generated by pgcli. Modern version of pgcli doesn't need csv format, and doesn't need --pgcli-fix option.

pager = /usr/bin/pspg --rr=2 --quit-if-one-screen --ignore-case

sqlcl

As sqlcl doesn't currently support a pager option directly, you can either use a tool like qsh to work around this issue, or use the pspg.sql script from this repo.

To use the script, start sqlcl as shown below (it's important to pass in the details of your current tty):

$ TTY=$(tty) sqlcl system/system @/path/to/pspg.sql

You can now have the results of a query sent to pspg like this:

SQL> pspg select * from user_tables;

Note - mouse

pspg try to use xterm mouse mode 1002, when terminal and ncurses are not too antique. If there are problems with usage - unwanted visual artefacts when you move with mouse when some mouse button is pressed, then 1. please, report issue (please, attach log file), 2. use an option --no-xterm-mouse-mode and pspg will not try to activate this mode.

Note - compilation issue

Some linker issues can be fixed by:

I changed gcc -lncursesw pager.c -o pspg -ggdb to gcc pager.c -o pspg -ggdb -lncursesw

If you want to use pspg as Postgres client, then you need run configure --with-postgresql=yes. On Fedora with own Postgres build I had to install openssl-devel package and I had to set export PKG_CONFIG_PATH="/usr/local/pgsql/master/lib/pkgconfig/".

On FreeBsd you should to use gmake instead make.

Note - Installation

When you compile code from source, run ./configure first. Sometimes ./autogen.sh first

If you would to display UTF-8 characters, then pspg should be linked with ncursesw library. UTF-8 characters are displayed badly when library ncursesw is used. You can see broken characters with incorrect locale setting too.

You can check wide chars support by pspg --version. Row ncurses with wide char support is expected. Re-run configure with --with-ncursesw option. When this command fails check if development package for ncuresesw library is installed.

Homebrew (for Linux & MacOS)

# brew install pspg

Debian

# apt-cache search pspg
# apt-get install pspg

Fedora (28 and later)

# dnf install pspg

RPM (CentOS/openSUSE/…)

The pspg is available from community repository https://yum.postgresql.org/packages.php

Alpine Linux

# apk add pspg

Gentoo

# emerge -av dev-db/pspg

Arch Linux

The Arch User Repository contains two versions:

• pspg is a fixed release.
• pspg-git tracks the master branch.

Use the AUR helper of your choice or git and makepkg to install pspg.

FreeBSD

# pkg install pspg

OpenBSD

# pkg_add pspg

More about it

Using MacPorts (MacOS only)

# port install pspg

Solaris

There are few issues requires manual code changes for successful compilation - we successfully tested pspg, but although pspg was linked with ncursesw libraries, the utf8 encoding support didn't work fully correctly - probably due some issues in libc library. There are problems with chars encoded to 3bytes - unicode borders, .. Two bytes unicode chars should be displayed well.

You can use pspg with usual accented chars, but unicode bordes should not be used. Replacement ascii borders by special borders chars (by ncurses technology) works well - looks on Options|Force unicode borders option.

Solaris make doesn't support conditional statements - should be removed So, remove unsupported functionality from Makefile (ifdef,endif), replace -include by include first.

After running configure remove link on termcap library from config.make. It is garabage produced by readline automake script. Combination with ncurses libraries makes some linking issues.

builtin libraries

export CURSES_CFLAGS="-I/usr/include/ncurses/"
export PANEL_LIBS="-lpanelw"
./configure

OpenCSW development

export CFLAGS="-m64 -I/opt/csw/include"
export LDFLAGS="-L/opt/csw/lib/64 -R/opt/csw/lib/64"
export PKG_CONFIG_PATH="/opt/csw/lib/64/pkgconfig"
./configure

Possible ToDo

Store data in some column format (now data are stored like array of rows). With this change can be possible to operate over columns - hide columns, change width, cyclic iteration over columns, change order of columns, mark columns and export only selected columns (selected rows).

Replace printing document directly to ncurses window by some smarter structure. Internally there are lot of checks and fixs to support complex dynamic layout. The possibly views should to remember first row, last row, current row. Now, these data are in global variables or in DataDesc and ScrDesc structures.

st_menu

This project uses st_menu library - implementation of CUA menubar and pulldown menu for ncurses https://github.com/okbob/ncurses-st-menu

Note

If you like it, send a postcard from your home country to my address, please:

Pavel Stehule
Skalice 12
256 01 Benesov u Prahy
Czech Republic

I invite any questions, comments, bug reports, patches on mail address pavel.stehule@gmail.com

---

Author: okbob
Source Code: https://github.com/okbob/pspg.
License: BSD-2-Clause License

#mysql #postgresql 

What is GEEK

Buddha Community

Landscapes Website Design | Nature Landscapes Website Designer

Most landscapers think of their website as an online brochure. In reality of consumers have admitted to judging a company’s credibility based on their web design, making your website a virtual sales rep capable of generating massive amounts of leads and sales. If your website isn’t actively increasing leads and new landscaping contracts, it may be time for a redesign.

DataIT Solutions specializes in landscape website designing that are not only beautiful but also rank well in search engine results and convert your visitors into customers. We’ve specialized in the landscaping industry for over 10 years, and we look at your business from an owner’s perspective.

Why use our Landscapes for your landscape design?

• Superior experience
• Friendly personal service
• Choice of design layout
• Budget sensitive designs
• Impartial product choice and advice
• Planting and lighting designs

Want to talk about your website?
If you are a gardener or have a gardening company please do not hesitate to contact us for a quote.
Need help with your website? Get in touch

#nature landscapes website design #landscapes website design #website design #website designing #website designer #designer

Designing Mobile Apps using the latest UI Design Principles

The mobile technology world is growing at the speed of light, and the apps have become an integral part of our daily life. We can now see an influx of technology with tools that can help create mobile apps. All of them are becoming more accessible and hence people are getting on their first app making journeys. Since the mobile app industry is getting bigger and better than ever, businesses from all corners of the world are trying to develop mobile apps for their operations and marketing. Designing a mobile app for businesses is the first step, though. Company owners are in charge of the basic look and feel of the designed product. With a brilliant mobile app design, one can establish a relationship between app and user very well.

Read Blog Here: https://www.indianappdevelopers.com/blog/designing-mobile-apps-using-latest-ui-design-principles/

#designing mobile apps #ui design principles #mobile ui design #mobile app design #ui design #app design

Security Website Design

As web developers, we strive to meet your specific needs by creating a website that is user-friendly and remains relevant to the current design trends. This ensures that your website grabs the attention of your audience and keeps you ahead of your competitors.

DataIT Solutions team of experts works collaboratively to create ideas that can meet your requirements. Our Website Designing Company believes in High-Quality Professional Website Designing for your Security Website Designing. Our designers have experience in working on a wide array of projects, including websites of the next generation. We listen to your needs and then deliver.

Our Expertise includes:

• Dot Net Development
• PHP Development
• HTML5 Development
• IOS App Development
• Android App Development
• Website Security services

Our team of experts has the expertise, knowledge, and skills to take control and dominate the web design industry over the next couple of years. They are on hand to listen to your ideas, goals, and help you to have a website that is unique and works with your business and brand.

Looking for a better design? Need a professional web design?
Get in touch with our, Web Design Professional experts.

#security website design #security website designing #security website designer #website designer #website designing #website design

How To Make Marvelous Microcopy: 7 Surefire Tips

Good microcopy is one of the fastest ways to improve an interface. Try doing an audit on your UI with these tips to see how it stands up.

1) Use personal pronouns

Address the reader instead of just talking out loud. Use the word you. People pay more attention when you talk directly to them.

#design #web-design #product-design #ux-design #ui-design #design-principles #microcopy #ux-writing

UI/UX Design Principles: Guide to Perfect App Designing Process - TopDevelopers.co

Following the app design process and UI/UX design principles rightly guide UI/UX designers to purvey app designs that help in developing efficient mobile apps.
In this article, we will discuss a perfect app designing process that will help you build a mobile app with a great design that attracts the targeted audience and increases user engagement, hence boosting the conversion rate for an app.

#role of ui & ux design in app development #app design tips to follow #ui/ux design strategies #app designing process #ui/ux designers #ui design