Te
s
ting in
production
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
IDG 2018 Cloud Survey
»
77% of enterprises have at least one application
in the cloud
»
60% of all IT infrastructure and, 60-70% of all
software, services and technology spending by
2020.
ht
tps:/
/w
w
w
.idg.com/
t
ools-for-marketers/2018-cloud-computing-survey
/
A
W
S, Google
and
Azure
turning int
o
an
API marketpl
a
ce
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
Major risk
s
are no
w
te
s
t
able onl
y
af
ter
deplo
yment
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
We can'
t
predict
unkno
wns,
but
we can spo
t
when
they
happen
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
1. Beha
viour change
s
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
Ba
seline
and
tr
a
ck
periodic
trends
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
Use beha
viour
change
s
a
s
a
ccept
ance criteria
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
2. Client
-side errors
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
Bro
w
sers
with cookie blocking
»
22.0% Globally
»
32.0% Germany
»
28.7% France
»
25.2% US
Bill
Fisher, eMarketer, ht
tps:/
/w
w
w
.emarketer.com/content
/
ad-blocking-in-
the-uk
-2018
Client
error
tr
a
cking popul
arit
y
»
Not tracking errors: 53%
»
Web analytics: 15%
»
Sentry.io: 15%
»
TrackJS.com: 4%
»
Rollbar.com: 3%
ht
tps:/
/go
jk
o.net
/
a
ssets/201802-
js-re
se
arch.pdf
sep
ar
a
ting signal
from noise is
critical
f
or client
-
side error
tr
a
cking
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
3. Log
anomalie
s
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
Popul
ar
t
ools
»
Splunk
»
Graylog
»
Logstash
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
Appro
a
ch logging
a
s
a
firs
t
-order
interf
a
ce
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
New
oppor
tunitie
s
»
Speed up testing
»
Safer deployments
»
New types of insights
Go
jk
o
Adzic @go
jk
o
adzic go
jk
o.net
SQ
A
D
a
ys 24, Mosco
w
Testing in production