Friday, March 31, 2023

Microsoft Security Copilot:, with GPT-4

 Introducing Microsoft Security Copilot: Empowering defenders at the speed of AI - The Official Microsoft Blog

 a global shortage of skilled security professionals, leading to an estimated 3.4 million openings in the field.

Microsoft Security Copilot is the first security product to enable defenders to move at the speed and scale of AI. Security Copilot combines this advanced large language model (LLM) with a security-specific model from Microsoft. 


Go OpenAI

sashabaranov/go-openai: OpenAI ChatGPT, GPT-3, GPT-4, DALL·E, Whisper API wrapper for Go


Note: the repository was recently renamed from go-gpt3 to go-openai

This library provides Go clients for OpenAI API. We support:
  • ChatGPT
  • GPT-3, GPT-4
  • DALL·E 2
  • Whisper
from

Thursday, March 30, 2023

free book: Cloud Native Security

 Cloud Native Security ($24.00 Value) FREE for a Limited Time Free eBook


more "free" books (need business email address)

Free Information Technology Research Library of White Papers, Magazines, Reports, and eBooks


Cloudflare: Workers Launchpad Demo Day

 Workers Launchpad Demo Day - Cloudflare TV

$2B VC investment!


including Drivly demo

driv.ly: automotive apis to buy & sell cars online

"virtual car dealership"


quest.ai: code generation tool for frontend (UI) of business apps


www.jempass.com: passwordless security (auth platform)

www.jem.network



Hello World in Rust · Cloudflare Workers docs

Wednesday, March 29, 2023

wikidata sparql examples

 Wikidata:SPARQL tutorial - Wikidata

Wikidata:SPARQL query service/queries/examples - Wikidata

Wikidata Query Service (movies on map)

Wikidata Query Builder

Wikidata Query Service

#Women Educated at Edinburgh university By Place of Birth

SELECT ?person ?personLabel 
(SAMPLE(?birth_date) as ?birth_date) 
(SAMPLE(?death_date ) as ?death_date ) 
(SAMPLE(?birth_place_label ) as ?birth_place_label ) 
(SAMPLE(?birth_place_coords ) as ?birth_place_coords ) 
(SAMPLE(?image ) as ?image ) 
(SAMPLE(?country ) as ?country) 
(COUNT(?article) as ?rank)
WHERE {  
  ?person wdt:P69 wd:Q160302 .
?person wdt:P31 wd:Q5 .
  ?person wdt:P21 wd:Q6581072 .
    OPTIONAL {?person wdt:P18 ?image }
  OPTIONAL {?person wdt:P18 ?image }
OPTIONAL {?person wdt:P569 ?birth_date }
  OPTIONAL {?person wdt:P27 ?countryItem .
              ?countryItem rdfs:label ?country filter (lang(?country) = "en")
        }
OPTIONAL {
             ?person wdt:P19 ?birth_place . 
             ?birth_place wdt:P625 ?birth_place_coords .
             ?birth_place rdfs:label ?birth_place_label filter ( lang(?birth_place_label) = "en" )
         }
OPTIONAL {?person wdt:P570 ?death_date } 
        OPTIONAL {?article schema:about ?person}     
   SERVICE wikibase:label {bd:serviceParam wikibase:language "en" }
}
GROUP BY ?person ?personLabel
ORDER BY DESC(?rank)
LIMIT 100

https://w.wiki/6V25 query

https://w.wiki/6V27 result
"timeline" view

"map" view



architecture: NYC, $3B

New York is Building the World’s Best Skyscraper

New York’s $3BN Skyscraper Gamble - YouTube


JPMorgan Chase unveils design for new global headquarters in a new skyscraper on Park Ave in NYC : r/nyc



Tuesday, March 28, 2023

graph database: Blazegraph

 Blazegraph Database

Blazegraph™ DB is a ultra high-performance graph database supporting Blueprints and RDF/SPARQL APIs. It supports up to 50 Billion edges on a single machine. It is in production use for Fortune 500 customers such as EMC, Autodesk, and many others. 



lyrasis/blazegraph - Docker Image | Docker Hub

docker run --name blazegraph -d -p 8889:8080 lyrasis/blazegraph:2.1.5

from class:

RDF and SPARQL Essentials @Udemy

A practical introduction to RDF, Turtle, TriG and SPARQL for authoring and querying knowledge graph data



You can load the file /tmp/blazgraph/data.n3 (for example, get this file) through the "Update" tab:   
load <file:///tmp/blazegraph/data.n3>




PREFIX : <http://looneytunes-graph.com/>
PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
PREFIX xsd: <http://www.w3.org/2001/XMLSchema#>

# Bugs Bunny
:Bugs_Bunny a :Looney_Tunes_Character ;
  :name "Bugs Bunny" ;
  :species "Hare" ;
  :gender "Male" ;
  :made_debut_appearance_in :A_Wild_Hare ;
  :created_by :Tex_Avery ;
  :personality_trait "Cunning" , "Charismatic" , "Smart" ;
  :known_for_catchphrase "What's up, doc?" .

# A Wild Hare
:A_Wild_Hare a :Short ;
  :release_date "1940-07-27"^^xsd:date .

# Tex Avery
:Tex_Avery a :Person ;
  :name "Frederick Bean Avery" ; 
  :born_on "1908-02-26"^^xsd:date ;
  :died_on "1980-08-26"^^xsd:date .

# Daffy Duck
:Daffy_Duck a :Looney_Tunes_Character ;
  :name "Daffy Damas Duck" ;
  :species "American Black Duck" ;
  :gender "Male" ;
  :made_debut_appearance_in :Porkys_Duck_Hunt ;
  :created_by :Tex_Avery ;
  :personality_trait "Assertive" , "Unrestrained" , "Combative" ;
  :known_for_catchphrase "You're despicable!" .

# Porky's Duck Hunt
:Porkys_Duck_Hunt a :Short ;
  :release_date "1937-04-17"^^xsd:date .

# Sylvester 
:Sylvester a :Looney_Tunes_Character ;
  :name "Sylvester James Pussycat, Sr." ;
  :species "Tuxedo Cat" ;
  :gender "Male" ;
  :made_debut_appearance_in :Life_With_Feathers ;
  :created_by :Friz_Freleng ;
  :personality_trait "Proud" , "Persistent" , "Loser" ;
  :known_for_catchphrase "Sufferin' Succotash" .

# Life With Feathers
:Life_With_Feathers a :Short ;
  :release_date "1945-03-24"^^xsd:date .

# Friz Frelang
:Friz_Freleng a :Person ;
  :name "Isadore Freleng" ;
  :born_on "1905-08-21"^^xsd:date ;
  :died_on "1995-05-26"^^xsd:date .

# Taz
:Taz a :Looney_Tunes_Character ;
  :name "Tasmanian Devil" ;
  :gender "Male" ;
  :species "Tasmanian Devil" ;
  :made_debut_appearance_in :Devil_May_Hare ;
  :created_by :Robert_McKimson , :Sid_Marcus ;
  :personality_trait "Dim-witted" , "Short-tempered" , "Impatient" .

# Devil May Hare
:Devil_May_Hare a :Short ;
  :release_date "1954-06-19"^^xsd:date .

# Robert McKimson
:Robert_McKimson a :Person ;
  :name "Robert Porter McKimson, Sr." ;
  :born_on "1910-10-13"^^xsd:date ;
  :died_on "1977-09-29"^^xsd:date .

# Sid Marcus
:Sid_Marcus a :Person ;
  :name "Sidney Marcus" ;
  :born_on "1877-10-14"^^xsd:date ;
  :died_on "1979-01-31"^^xsd:date .

then must change "type" to "RDF Data" and Format to "Turtle" (TTT)
then click [Update] button







Monday, March 27, 2023

Oracle Cloud <=> Azure

 OCI Azure Interconnect | Oracle

The traffic between Azure and Oracle Cloud flows directly through the private physical connection with round-trip latency of under 2 ms.

Sunday, March 26, 2023

GPT-4 = AGI ? danger

the question was asked on this podcast...

it may be too early, but even talking about it now may a reason to be concerned...

#367 – Sam Altman: OpenAI CEO on GPT-4, ChatGPT, and the Future of AI | Lex Fridman Podcast

GPT-4

ChatGPT | OpenAI

GPT-4 API waitlist

GPT-4 Developer Livestream - YouTube


Artificial general intelligence - Wikipedia



Elon Musk, other tech leaders: Pause training A.I. beyond GPT-4

Elon Musk and dozens of other technology leaders have called on AI labs to pause the development of systems that can compete with human-level intelligence.
In an open letter from the Future of Life Institute, signed by Musk, Apple co-founder Steve Wozniak and 2020 presidential candidate Andrew Yang, AI labs were urged to cease training models more powerful than GPT-4, the latest version of the large language model software developed by U.S. startup OpenAI.

data: Wikidata + SPARQL API

Wikidata - Wikipedia

Wikidata is a collaboratively edited multilingual knowledge graph hosted by the Wikimedia Foundation.[2] It is a common source of open data that Wikimedia projects such as Wikipedia

Wikidata

Wikidata is a free and open knowledge base that can be read and edited by both humans and machines.

Wikidata acts as central storage for the structured data of its Wikimedia sister projects including Wikipedia, Wikivoyage, Wiktionary, Wikisource, and others.

Wikidata:SPARQL tutorial - Wikidata



SPARQL (pronounced "sparkle/ˈspɑːkəl/, a recursive acronym[2] for SPARQL Protocol and RDF Query Language) is an RDF query language—that is, a semantic query language for databases—able to retrieve and manipulate data stored in Resource Description Framework (RDF) format.

example:

q = `#Movies released in 2017
SELECT DISTINCT ?item ?itemLabel WHERE {
  ?item wdt:P31 wd:Q11424.
  ?item wdt:P577 ?pubdate.
  FILTER((?pubdate >= "2017-01-01T00:00:00Z"^^xsd:dateTime) && (?pubdate <= "2017-12-31T00:00:00Z"^^xsd:dateTime))
  SERVICE wikibase:label { bd:serviceParam wikibase:language "[AUTO_LANGUAGE],en". }
}`

GET https://query.wikidata.org/sparql?query=uleEncode(q)

#Movies with Bruce Willis
SELECT ?item ?itemLabel (MIN(?date) AS ?firstReleased) ?_image
WHERE {
  ?item wdt:P161 wd:Q2680;
        wdt:P577 ?date
  SERVICE wikibase:label { bd:serviceParam wikibase:language "[AUTO_LANGUAGE],en". }
  OPTIONAL { ?item wdt:P18 ?_image. }
} GROUP BY ?item ?itemLabel ?_image
ORDER BY (?date)



examples:

item types

film - Wikidata = movie (Q11424)

prop types

cast member - Wikidata (P161) (actor in movie)


item ids

Bruce Willis - Wikidata (Q2680)

Tom Hanks - Wikidata (Q2263)


Saturday, March 25, 2023

Wikidata sparql examples

 Research in programming Wikidata/Cities - Wikiversity

Which country has the most sister cities?
#defaultView:BubbleChart
SELECT ?countryLabel (COUNT(?sister) as ?sisterCount) WHERE {       # Selecting number of distinct sister cities of particular country cities which are ... 
  SELECT DISTINCT ?countryLabel ?sister WHERE {                           
    VALUES ?cityTypes {wd:Q3957 wd:Q515 wd:Q1549591 wd:Q1637706}
    ?city wdt:P31 ?cityTypes.                                       # ... instances of different types of cities ...
    ?city wdt:P17 ?country.                                         # ... with filled property "country" ...
    ?city wdt:P190 ?sister.                                         # ... with filled property "sister city"
    SERVICE wikibase:label { bd:serviceParam wikibase:language "en". }
  }                                 
}
GROUP BY ?countryLabel

ORDER BY DESC(?sisterCount)

Wikidata:SPARQL tutorial - Wikidata

# (film) items with "cast member P161" including "tom hanks Q2263"

SELECT DISTINCT ?item ?itemLabel WHERE {
 SERVICE wikibase:label { bd:serviceParam wikibase:language "[AUTO_LANGUAGE]". }
 {
  SELECT DISTINCT ?item WHERE {
   ?item p:P161 ?statement0. # cast member
   ?statement0 (ps:P161/(wdt:P279*)) wd:Q2263. # tom hanks
  }
  LIMIT 100
 }
}

# simplified, same
SELECT DISTINCT ?item ?itemLabel 
WHERE {
  ?item p:P161 ?statement0. # cast member
  ?statement0 (ps:P161/(wdt:P279*)) wd:Q2263. # tom hanks
  SERVICE wikibase:label { bd:serviceParam wikibase:language "en". }
}
LIMIT 100


data: Freebase, Wikidata, DBpedia (from Wikipedia)

Freebase (database) - Wikipedia

Data Dumps  |  Freebase API (Deprecated)  |  Google Developers

1.9B RDF triples, 31 GB

Freebase Easy - Dataset Download

3.3 GB

Freebase Easy (Cities in Europe)








Both projects publish RDF data about entities. The source of the data is very different: whereas DBpedia extracts the data from the infoboxes, Wikidata will collect data entered through its interfaces. 

Data in Wikidata will also be annotated with its provenance: it does not simply state the population of Germany, but it also requires a source to be given for the data. The two data repositories will co-exist.



DBpedia (from "DB" for "database") is a project aiming to extract structured content from the information created in the Wikipedia project.


The Developers page lists the file as 22 GB gzip compressed and 250 GB uncompressed, although a recent download exceeds this file size (a May 2016 download amounted to >30 GB compressed and >400 GB uncompressed).



Friday, March 24, 2023

in-security: GitHub RSA key changed

 We updated our RSA SSH host key | The GitHub Blog

reason: GitHub.com’s RSA SSH private key was briefly exposed in a public GitHub repository.

need to remove the old key by running this command:

$ ssh-keygen -R github.com

Or manually updating your ~/.ssh/known_hosts file to remove the old entry.

.NET Hot Reload

 .NET 6 Hot Reload in Visual Studio 2022, VS Code, and NOTEPAD?!? - YouTube

> dotnet new console

> dotnet run

hot reload:

> dotnet watch run 

// in implicit "Main" class and method, changes => hot reload changes pid
// Console.WriteLine($"Hello, World! pid: {System.Diagnostics.Process.GetCurrentProcess().Id}");

var u = new Utils();
while (true) {
    u.WritePid();
    Thread.Sleep(1000);
}

public class Utils { // changes => hot reload preserves pid!
    public void WritePid() {
        Console.WriteLine($"Hello, World! pid: {System.Diagnostics.Process.GetCurrentProcess().Id}");
    }
}



Thursday, March 23, 2023

EV: Tesla New Lithium Giga Refinery

Tesla Announces New Lithium Giga Refinery! - YouTube


Elon Musk talks for 13 minutes straight at Tesla Investor Day 2023 - Worries about AI (supercut) - YouTube



data: IMDb

IMDb

Subsets of IMDb data are available for access to customers for personal and non-commercial use. You can hold local copies of this data, and it is subject to our terms and conditions. 

The dataset files can be accessed and downloaded from https://datasets.imdbws.com/. The data is refreshed daily.


IMDb Developer

Introducing the New IMDb API
Get the latest IMDb data on-demand through our new GraphQL-backed API. Available exclusively via AWS Data Exchange

very expensive!!! price: $150,000, $400,000


similar, free? not...




Wednesday, March 22, 2023

data formats: CSV vs Apache Parquet

 Different types of data formats CSV, Parquet, and Feather | by Som | MLearning.ai | Medium

Parquet is lightweight for saving data frames. Parquet uses efficient data compression and encoding scheme for fast data storing and retrieval. Parquet with “gzip” compression (for storage): It is slightly faster to export than just .csv (if the CSV needs to be zipped, then parquet is much faster). Importing is about 2x times faster than CSV. The compression is around 22% of the original file size, which is about the same as zipped CSV files.

Feather format is more efficient compared to parquet format in terms of data retrieval. Though it occupies comparatively more space than parquet format storing in this format will ensure efficient data retrieval.


Apache Parquet - Wikipedia

Apache Parquet is comparable to RCFile and Optimized Row Columnar (ORC) file formats — all three fall under the category of columnar data storage within the Hadoop ecosystem. They all have better compression and encoding with improved read performance at the cost of slower writes. In addition to these features, Apache Parquet supports limited schema evolution, i.e., the schema can be modified according to the changes in the data. It also provides the ability to add new columns and merge schemas that do not conflict.

Apache Arrow is designed as an in-memory complement to on-disk columnar formats like Parquet and ORC. The Arrow and Parquet projects include libraries that allow for reading and writing between the two formats.


apache/parquet-format: Apache Parquet @GitHub

Java

Feather File Format — Apache Arrow v11.0.0

Feather is a portable file format for storing Arrow tables or data frames (from languages like Python or R) that utilizes the Arrow IPC format internally. Feather was created early in the Arrow project as a proof of concept for fast, language-agnostic data frame storage for Python (pandas) and R. 


parquetjs - npm: JavaScript

This package contains a fully asynchronous, pure JavaScript implementation of the Parquet file format. The implementation conforms with the Parquet specification and is tested for compatibility with Apache's Java reference implementation.

What is Parquet?: Parquet is a column-oriented file format; it allows you to write a large amount of structured data to a file, compress it and then read parts of it back out efficiently. The Parquet format is based on Google's Dremel paper.


GoLang






Tuesday, March 21, 2023

Modern Web Front End Development

 .NET Rocks! Modern Web Front End Development with Amy Kapernick

Links:


Monday, March 20, 2023

The Most Popular Node.js Frameworks in 2023

 The Most Popular Node.js Frameworks in 2023 - Stack Diary


FrameworkDescriptionReleasedGrowth
Next.jsThe React Framework2016+53.3/day
tRPCMove Fast and Break Nothing. End-to-end typesafe APIs made easy.2020+51.5/day
NestA progressive Node.js framework for building efficient, scalable, and enterprise-grade server-side applications on top of TypeScript & JavaScript.2017+26.5/day
RemixBuild Better Websites. Create modern, resilient user experiences with web fundamentals.2020+24.3/day
StrapiStrapi is the leading open-source headless CMS. It’s 100% JavaScript, fully customizable and developer-first.2015+23.7/day
SvelteKitweb development, streamlined2020+17.6/day
DirectusDirectus is an instant REST+GraphQL API and intuitive no-code data collaboration app for any SQL database.2012+17.1/day
RedwoodThe App Framework for Startups2019+12.7/day
NuxtNuxt is an intuitive and extendable way to create type-safe, performant and production-grade full-stack web apps and websites with Vue 3.2016+12.4/day
FastifyFast and low overhead web framework, for Node.js2016+11.3/day
ExpressFast, unopinionated, minimalist web framework for node.2009+10.8/day
KeystoneThe most powerful headless CMS for Node.js — built with GraphQL and React2018+4.9/day