lp:~bigdata-dev/bigdata-data/snap-hadoop

Created by Kevin W Monroe on 2017-09-07 and last modified on 2017-10-04
Get this branch:
bzr branch lp:~bigdata-dev/bigdata-data/snap-hadoop

Branch merges

Related bugs

Related blueprints

Branch information

Owner:
Juju Big Data Development
Project:
Juju Big Data Resources
Status:
Development

Import details

Import Status: Reviewed

This branch is an import of the HEAD branch of the Git repository at https://github.com/juju-solutions/snap-hadoop.git.

The next import is scheduled to run in 18 minutes.

Last successful import was 5 hours ago.

Import started 5 hours ago on alnitak and finished 5 hours ago taking 20 seconds — see the log
Import started 12 hours ago on alnitak and finished 12 hours ago taking 20 seconds — see the log
Import started 18 hours ago on alnitak and finished 18 hours ago taking 20 seconds — see the log
Import started on 2019-08-18 on alnitak and finished on 2019-08-18 taking 20 seconds — see the log
Import started on 2019-08-18 on alnitak and finished on 2019-08-18 taking 20 seconds — see the log
Import started on 2019-08-18 on alnitak and finished on 2019-08-18 taking 20 seconds — see the log
Import started on 2019-08-17 on alnitak and finished on 2019-08-17 taking 20 seconds — see the log
Import started on 2019-08-17 on alnitak and finished on 2019-08-17 taking 15 seconds — see the log
Import started on 2019-08-17 on alnitak and finished on 2019-08-17 taking 20 seconds — see the log
Import started on 2019-08-16 on alnitak and finished on 2019-08-16 taking 20 seconds — see the log

Recent revisions

35. By Kevin W Monroe on 2017-10-04

rename wrappers to something less generic (helps prevent namespace collisions)

34. By Kevin W Monroe on 2017-10-04

move m2 logic to snapcraft.yaml; use SNAP_COMMON for pid dirs; add configure hook to ensure dirs are always available

33. By Kevin W Monroe on 2017-10-04

simplify patches (we have our own wrappers; no need to patch install); move the m2 settings patch into snapcraft.yaml

32. By Kevin W Monroe on 2017-09-29

drop the -snap version suffix; update desc; move to stable

31. By Kevin W Monroe on 2017-09-27

add mapred pseudo config; change hadoop-conf slot to write; all hadoopy snaps should now look for config in $snap_data

30. By Kevin W Monroe on 2017-09-27

exit 1 on do-comp-build failures

29. By Kevin W Monroe on 2017-09-16

eek! wrong staged bits for last commit. fix em.

28. By Kevin W Monroe on 2017-09-16

combine daemons, use install vs configure hook

- hdfs/mapred/yarn daemons do almost the same thing; make a single
wrapper figure out the right task based on args.

- the configure hook runs *after* systemctl services. we need
something earlier to setup snap_data, so do it in the install hook.

- tweak sed logic in install hook to ensure we change right values.

- tweak error/warning messages in our wrappers.

- snapcraft.yaml changes:
  - remove unused hadoop /etc/default bits (covered by common-wrapper).
  - bump to snap5.

27. By Kevin W Monroe on 2017-09-15

bump to snap4

26. By Kevin W Monroe on 2017-09-15

hook and wrapper work to support hadoop daemons

- add yarn config to configure hook

- if we have a pseudo cluster, format the NN with the configure hook
to lessen user burden (requires the hook to have the network plug)

- add network[-bind] to all hadoop apps and daemons since they all
do java network activity

- add 5 hadoop daemons (2 hdfs, 2 yarn, 1 jobhistory)

- be more explicit about errors vs warnings in our wrappers

Branch metadata

Branch format:
Branch format 7
Repository format:
Bazaar repository format 2a (needs bzr 1.16 or later)
This branch contains Public information 
Everyone can see this information.