bitbake.git
9 years agoFix more incorrect usages of 'is'
Chris Larson [Tue, 8 Mar 2011 19:07:24 +0000 (12:07 -0700)]
Fix more incorrect usages of 'is'

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agocodeparser: use ==, not 'is' to compare strings
Chris Larson [Tue, 8 Mar 2011 18:54:45 +0000 (11:54 -0700)]
codeparser: use ==, not 'is' to compare strings

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agocodeparser: fix ShellSyntaxError usage
Chris Larson [Wed, 16 Mar 2011 14:38:18 +0000 (07:38 -0700)]
codeparser: fix ShellSyntaxError usage

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agobb.siggen: import os
Chris Larson [Tue, 8 Mar 2011 23:29:22 +0000 (16:29 -0700)]
bb.siggen: import os

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agoutils: fix typo in lockfile
Chris Larson [Tue, 8 Mar 2011 16:39:40 +0000 (09:39 -0700)]
utils: fix typo in lockfile

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agolockfile: ask for forgiveness, not permission
Chris Larson [Tue, 8 Mar 2011 16:33:40 +0000 (09:33 -0700)]
lockfile: ask for forgiveness, not permission

Create the lockfile directory if it doesn't exist, rather than erroring out if
it doesn't exist (was also racy).

Also improve the wording of the error message shown when the lockfile's
directory is not writable.

Note for the future, this function should be improved, particularly with
regard to its exception handling. It should be catching the *exact*
exception(s) it will encounter when the file is locked, and continuing in that
case only. If it did that, there'd be no need for the proactive directory
writability check, as bb.utils.lockfile() would raise an appropriate IOError
for that case.

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agohob: adjust for master's eventHandler API
Chris Larson [Mon, 7 Mar 2011 23:01:21 +0000 (16:01 -0700)]
hob: adjust for master's eventHandler API

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agogoggle: exit quietly on ^C
Chris Larson [Mon, 7 Mar 2011 22:54:29 +0000 (15:54 -0700)]
goggle: exit quietly on ^C

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agobitbake/cache: bump cache version after recent changes
Joshua Lock [Thu, 24 Feb 2011 16:02:13 +0000 (16:02 +0000)]
bitbake/cache: bump cache version after recent changes

(From Poky rev: 08c7a59b5a5d24cf8c03b9da8278d30c0c175f5e)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/progress: make progress dialog modal for parent window
Joshua Lock [Wed, 2 Feb 2011 20:14:41 +0000 (20:14 +0000)]
bitbake/progress: make progress dialog modal for parent window

(From Poky rev: f258cedfe8432d61eebd21a239381e9510be7109)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoAdd new UI hob, a prototype Gtk+ GUI for creating images
Joshua Lock [Wed, 2 Feb 2011 13:02:43 +0000 (13:02 +0000)]
Add new UI hob, a prototype Gtk+ GUI for creating images

Hob is a first stab at implementing an interactive GUI for BitBake.

(From Poky rev: 6dbceb0be9a1b8d7d5124b4fbd74f18609bc6146)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/cooker: don't drop possible_world ref count
Joshua Lock [Wed, 2 Feb 2011 12:48:10 +0000 (12:48 +0000)]
bitbake/cooker: don't drop possible_world ref count

We need this if we want to run the buildWorldTargetList function more than
once, for example in a UI where we can change the MACHINE and DISTRO as much
as we like before triggering a build.

(From Poky rev: c2814caa5d80d3a1097c83b82b7a3f8eeb8da548)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/progress: add method to pulse the progress bar
Joshua Lock [Tue, 1 Feb 2011 15:23:47 +0000 (15:23 +0000)]
bitbake/progress: add method to pulse the progress bar

When we're running a long operation with indeterminate duration it's useful
to use the gtk.ProgressBar's pulse method to show that something is happening
but we don't know how long it will take.

(From Poky rev: fb62c54e13e875dd81e0b5220c54a7753b4d5fa2)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/crumbs: update documentation header
Joshua Lock [Wed, 19 Jan 2011 17:20:46 +0000 (17:20 +0000)]
bitbake/crumbs: update documentation header

(From Poky rev: 7f8aa691c52547ee5f1272a7931ca9cccd1a120a)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/event: fix some whitespace issues
Joshua Lock [Thu, 13 Jan 2011 18:30:02 +0000 (18:30 +0000)]
bitbake/event: fix some whitespace issues

(From Poky rev: b14cda62d075d1213fc4769aa6b3622a491b57d5)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agointroduce crumbs.TaskListModel a gtk.ListStore subclass
Joshua Lock [Wed, 12 Jan 2011 12:24:04 +0000 (12:24 +0000)]
introduce crumbs.TaskListModel a gtk.ListStore subclass

Provide a gtk.ListStore subclass which includes a function,
populate(), which takes as input the data emitted by
bb.event.TargetsTreeGenerated and fills the ListStore model
appropriately.
Furthermore convenience functions are provided by which the caller can
get gtk.TreeModel subclasses which provide filtered views of the data.

(From Poky rev: 9b43eaff99615d8bd58b2f3a54c280e5470d3a9c)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/[cooker|cache]: cache summary, license and group. Add to targets tree
Joshua Lock [Fri, 7 Jan 2011 12:57:18 +0000 (12:57 +0000)]
bitbake/[cooker|cache]: cache summary, license and group. Add to targets tree

Add summary, license and group metadata to RecipeInfo and the cache.
Unfortunately this impacts parse speed but gives us a much richer set of
metadata to expose through UI's which can be accessed via the
generateTargetsTree command.

(From Poky rev: a13304e1c6500db95823961a5a34849db46037e3)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/cooker: reduce code duplication
Joshua Lock [Fri, 7 Jan 2011 12:00:09 +0000 (12:00 +0000)]
bitbake/cooker: reduce code duplication

Move runqueua and taskdata initialisation into a new function,
prepareTreeData(), so that generateDepTreeData() and
generateTargetsTreeData() are not duplicating the same logic.

(From Poky rev: 3c1a3b0724d5175e81ec81cce448d5b618d21958)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/cooker: add generateTargetsTree method
Joshua Lock [Fri, 7 Jan 2011 11:45:00 +0000 (11:45 +0000)]
bitbake/cooker: add generateTargetsTree method

The generateTargetsTree() command needs to return a model which includes more
metadata than the one generated by generateDepTree().

This patch adds a new method generateTargetsTreeData() to the cooker, based
on generateDepData(), and switches generateTargetsTree() to use it.

(From Poky rev: dcfc5ae7b1f5925587b0675e1cba6c60f098267c)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoimplement command to find configuration files for a config variable
Joshua Lock [Tue, 4 Jan 2011 20:28:20 +0000 (20:28 +0000)]
implement command to find configuration files for a config variable

Some configuration variables (MACHINE, MACHINE-SDK and DISTRO) set which
confguration files bitbake should use.
The added command , findConfigFiles, enables a UI to query which files are
suitable values for a specified parameter.

(From Poky rev: 3939a216a53f58831e640e85ed95f7edff3ca76f)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoimplement command to get all possible targets and their dependencies
Joshua Lock [Tue, 4 Jan 2011 20:08:51 +0000 (20:08 +0000)]
implement command to get all possible targets and their dependencies

Add a new command generateTargetsTree() which returns a dependency tree of
possible targets (tasks and recipes) as well as their dependency information.

Optional parameter 'klass' also ensures any recipes which inherit the
specified class path (i.e. 'classes/image.bbclass') are included in the model

(From Poky rev: 1b3eb0c35f504e8f652303a4b238034ecc5c5d02)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/cache: store a list of inherited files in the cache
Joshua Lock [Tue, 4 Jan 2011 17:34:30 +0000 (17:34 +0000)]
bitbake/cache: store a list of inherited files in the cache

(From Poky rev: 920c402342bd490cd94b365c3e151de735dec0d6)

Signed-off-by: Joshua Lock <josh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoserver: use local fixed _bootstrap when appropriate
Chris Larson [Sun, 27 Feb 2011 22:11:18 +0000 (15:11 -0700)]
server: use local fixed _bootstrap when appropriate

When running on python versions 2.6.0 through 2.6.2, we use a local copy
of the python 2.6.6 _bootstrap method of Process, to ensure that we have
the fix for http://bugs.python.org/issue5313. This avoids the "hang" of
the bitbake process at 0% progress during the parsing on older distros
like Fedora 12.

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agobitbake-layers: drop 2.6 from #!, per Joshua Lock
Chris Larson [Thu, 3 Mar 2011 14:15:47 +0000 (07:15 -0700)]
bitbake-layers: drop 2.6 from #!, per Joshua Lock

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agofetch, fetch2: Get rid of DeprecationWarning notice
Khem Raj [Wed, 2 Mar 2011 08:33:49 +0000 (08:33 +0000)]
fetch, fetch2: Get rid of DeprecationWarning notice

* This patch fixes a cosmetic issue currently we get with master

WARNING: /home/kraj/work/bitbake/lib/bb/fetch2/__init__.py:733:
DeprecationWarning: Call to deprecated function bb.mkdirhier: Please use bb.utils.mkdirhier instead.  bb.mkdirhier("%s/%s" % (rootdir, destdir))

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agobitbake/utils.py: Allow join_deps to return a list that isn't comman separated
Richard Purdie [Fri, 25 Feb 2011 16:31:40 +0000 (16:31 +0000)]
bitbake/utils.py: Allow join_deps to return a list that isn't comman separated

(From Poky rev: 2069a29a8256bc94e6c1137da78d7b129a8cd4e8)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobuild: add missing newline
Chris Larson [Sat, 26 Feb 2011 00:05:56 +0000 (17:05 -0700)]
build: add missing newline

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agobuild: switch to old cwd handling
Chris Larson [Fri, 25 Feb 2011 22:36:15 +0000 (15:36 -0700)]
build: switch to old cwd handling

We want this to ensure the user can run the run. script from anywhere.

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agocooker: use BBHandler.inherit for INHERIT
Chris Larson [Thu, 24 Feb 2011 20:16:43 +0000 (13:16 -0700)]
cooker: use BBHandler.inherit for INHERIT

Ideally we'd avoid direct BBHandler usage, but honestly, to say the whole
bb.parse abstraction is incredibly leaky is an understatement.  If we try to
make handle() not reparse classes, things get ugly fairly quickly, as
inherit() calls handle() itself after adding the class to the inherit cache.

This change fixes it so we no longer risk reparsing a class if:

- it's listed in INHERIT multiple times
- it's listed in INHERIT and is 'inherit'ed from a class in INHERIT

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agocooker: simplify self.configuration.data vs data usage
Chris Larson [Wed, 23 Feb 2011 17:17:53 +0000 (10:17 -0700)]
cooker: simplify self.configuration.data vs data usage

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agobuild.py: Operate logfile handling at the task level
Richard Purdie [Thu, 24 Feb 2011 22:02:19 +0000 (22:02 +0000)]
build.py: Operate logfile handling at the task level

Previously, not all task output could end up in the logfile and
sub functions run using exec_func() calls would end up logging to
/dev/null. This is extrememly confusing for users who want to find
the output from a given task as there are several possible log files,
or it might not be there at all.

This patch changes exec_task() to redirect standard output/error
to the logfile along with any python logging output. This change is
applied for all python/shell tasks so it doesn't matter whether output
comes from os.system() calls or wherever, the logs are always correct.

This also removed the ton of log files previous code could generate
in ${T}, again making this simpler for users.

Based upon patches from Poky.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobuild.py: Improve exec_task standalone usage
Richard Purdie [Thu, 24 Feb 2011 21:53:59 +0000 (21:53 +0000)]
build.py: Improve exec_task standalone usage

This commit consolidates all the task execution code and exception
handling into one place, the exec_task funciton where it should be.

This function now returns an exit code value and handles all exceptions.

This ensures the task success/failure/invalid events are always sent.

TaskInvalid also becomes an event rather than being an exception.

Based upon changes in Poky.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/data_smart: Improve Variable expansion error handling
Richard Purdie [Wed, 23 Feb 2011 13:13:31 +0000 (13:13 +0000)]
bitbake/data_smart: Improve Variable expansion error handling

If expanding a variable triggers an exception the caller currently has no
way to supress the error message or otherwise handle the siutation. An
example of where this is a problem is "bitbake -e" showing tracebacks and
errors for variables like SRCPV in OE/Poky.

Secondly in a chained expansion fails, log mesages are recorded for
every step of the expansion, not just the innermost error which is
where the real failure occured.

To fix this we introduce a new exception ExpansionError which callers
can handle as appropriate.

(From Poky rev: 101b599110f7bc29f52a14a968f30323aeb797ca)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/data_smart: Improve the way lazyassignment works
Richard Purdie [Wed, 23 Feb 2011 11:48:01 +0000 (11:48 +0000)]
bitbake/data_smart: Improve the way lazyassignment works

Currently, if a variable has been set with ??= and the code looks it up
before the data finalisation phase, no value is found. This is causes
serious problems for anonymous python functions which manipulate data, or
for the fetcher revision handling code where revisions can be set with
??=.

There is also a significant performance implication for processing lazy
assignment in finalise.

Moving the check for a default value into getVarFlag addresses both
the timing issue and the performace. This change gives a 7% real time
performance improvement to parsing the Poky metadata. The cost of the
check at this point is minimal since we have all the data flags available.

This should also fix Yocto bug 752.

(From Poky rev: 6ea24f04cd635295d826f03d9c7d8a08cc1d5b31)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Ensure SRCREV_pn-PN is checked for a revision when the SRC_URI is...
Richard Purdie [Wed, 23 Feb 2011 11:47:50 +0000 (11:47 +0000)]
bitbake/fetch2: Ensure SRCREV_pn-PN is checked for a revision when the SRC_URI is unnamed

(From Poky rev: 707132c60a84cdcf50da056c68f2da7402d3b2e8)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/cooker: Fix parsing failure zombie problem
Richard Purdie [Wed, 23 Feb 2011 11:09:07 +0000 (11:09 +0000)]
bitbake/cooker: Fix parsing failure zombie problem

When parsing if a SystemExit event is triggered, it causes the parsing thread to
exit and the main process hangs waiting for it to finish indefintely. Add code to
catch BaseExceptions and raise these with the main process gracefully instead
of just hanging indefinitely with zombie processes.

(From Poky rev: 56a92105fe6b779c69bccd44c2cff8f21cafdfbd)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fecth2: Ensure BB_FETCH_PREMIRRORONLY being set as false is handled correctly
Richard Purdie [Wed, 16 Feb 2011 12:35:35 +0000 (12:35 +0000)]
bitbake/fecth2: Ensure BB_FETCH_PREMIRRORONLY being set as false is handled correctly

(From Poky rev: 3ef2d39dbf8a573acfbf633c1d5d7cb3cee18788)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Revert part of the unpack change until the issues with it are resolved
Richard Purdie [Sun, 13 Feb 2011 00:05:06 +0000 (00:05 +0000)]
bitbake/fetch2: Revert part of the unpack change until the issues with it are resolved

(From Poky rev: b9a97e07b48b20b00feff5b8c7196c3a3b7762b6)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agofetch2: unpack revision
Mark Hatle [Fri, 11 Feb 2011 17:43:54 +0000 (11:43 -0600)]
fetch2: unpack revision

Revise the unpack function to have a way to disable the unpack.  This is
based on the work from "Andreas Oberritter <obi@opendreambox.org>", see
http://cgit.openembedded.net/cgit.cgi/openembedded/commit/?id=2bdfe8519eda8067845019a699acdf19a21ba380

In addition, the to_boolean function comes from the work of
"Chris Larson <chris_larson@mentor.com>", see
http://cgit.openembedded.net/cgit.cgi/openembedded/commit/?id=900cc29b603691eb3a077cb660545ead3715ed54

(From Poky rev: 3faa635fd408695dd5b754fda3f6060dd670b81d)

Signed-off-by: Mark Hatle <mark.hatle@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Add explict network access exception and handling to give users usabl...
Richard Purdie [Fri, 11 Feb 2011 22:08:21 +0000 (22:08 +0000)]
bitbake/fetch2: Add explict network access exception and handling to give users usable error messages

(From Poky rev: 029f19bd3d4dc09fb48bf6e5322d48bb84c4eb34)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Fix patch merge error
Richard Purdie [Fri, 11 Feb 2011 16:24:26 +0000 (16:24 +0000)]
bitbake/fetch2: Fix patch merge error

(From Poky rev: 132ec8d3b7e5916c64de85b248632021f51701d3)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Add some debug output so its clear when PREMIRRORS, upstream and...
Richard Purdie [Fri, 11 Feb 2011 16:16:51 +0000 (16:16 +0000)]
bitbake/fetch2: Add some debug output so its clear when PREMIRRORS, upstream and MIRRORS are being used

(From Poky rev: a72d49478e57b05b99cb1b3beec62a9e79a24e7a)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Ensure network access status is reset for each loop iteration in...
Richard Purdie [Fri, 11 Feb 2011 16:15:36 +0000 (16:15 +0000)]
bitbake/fetch2: Ensure network access status is reset for each loop iteration in download()

(From Poky rev: 20afb21a375b6a5f0d4ff6e269eeee121d6f087a)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2/wget: Fix missing string parameter reference
Richard Purdie [Fri, 11 Feb 2011 12:16:44 +0000 (12:16 +0000)]
bitbake/fetch2/wget: Fix missing string parameter reference

(From Poky rev: 05d8b6422dc3154b2890f8db3f919faec4457d6f)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Ensure failed fetch attempts are logged in the debug logs
Richard Purdie [Fri, 11 Feb 2011 12:14:20 +0000 (12:14 +0000)]
bitbake/fetch2: Ensure failed fetch attempts are logged in the debug logs

(From Poky rev: ea70c4362fdb81bc9467975c145c48196c45e3af)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Correctly handle git mirror tarball fetching
Richard Purdie [Fri, 11 Feb 2011 12:06:44 +0000 (12:06 +0000)]
bitbake/fetch2: Correctly handle git mirror tarball fetching

(From Poky rev: 7f30131faaa5e3fdb1191c9da95c5683cefafeb5)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Pass over malformatted (empty) mirror url lines
Richard Purdie [Fri, 11 Feb 2011 12:04:59 +0000 (12:04 +0000)]
bitbake/fetch2: Pass over malformatted (empty) mirror url lines

(From Poky rev: 20ab1cb0ca10b0c7724f2154fe5b54c939b8a887)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Fix message about md5 checksums when sha256 is incorrect
Richard Purdie [Fri, 11 Feb 2011 21:59:23 +0000 (21:59 +0000)]
bitbake/fetch2: Fix message about md5 checksums when sha256 is incorrect

(From Poky rev: 4a226460d5e158e8adbf74a68717cb9a923e8009)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoprocess.py: Avoid deprecation warning
Richard Purdie [Mon, 14 Feb 2011 16:32:07 +0000 (16:32 +0000)]
process.py: Avoid deprecation warning

bitbake/lib/bb/process.py:15: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6

(From Poky rev: 6cb8fd6def4912e4aa76330649ba42a9ed2694fd)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/build.py: When looking up extra stamp info for setscene tasks, use the real...
Richard Purdie [Thu, 27 Jan 2011 11:20:50 +0000 (11:20 +0000)]
bitbake/build.py: When looking up extra stamp info for setscene tasks, use the real taskname

(Fixed based on a bug reported by Dongxiao Xu <dongxiao.xu@intel.com>)

(From Poky rev: c34913ea5a4f20ce4bca3c68a65e9f64f1e3910c)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/unlockfile: Fix exception handling
Richard Purdie [Wed, 26 Jan 2011 12:20:14 +0000 (12:20 +0000)]
bitbake/unlockfile: Fix exception handling

(From Poky rev: 5f866ac84f72699139be1d98f010017c7b71f0f7)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/utils: Ignore OSError in unlockfile
Richard Purdie [Mon, 24 Jan 2011 14:26:50 +0000 (14:26 +0000)]
bitbake/utils: Ignore OSError in unlockfile

(From Poky rev: 74783fec56d6ced1a793b36410233472e7daf445)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agosiggen.py: better print for task hash comparison
Kevin Tian [Thu, 20 Jan 2011 05:54:51 +0000 (13:54 +0800)]
siggen.py: better print for task hash comparison

current bitbake-diffsigs simply print out the whole 'runtaskdeps' when there's mismatch, which
is not very readable. On the other hand, 'runtaskhashes' comparison is broken which assumes
same key existing in two sides. This commit provides better output by figuring out differences
from addition, removal or hash change.

(From Poky rev: bcb18738361ee2394bc266911e9e75d5bf1c10cd)

Signed-off-by: Kevin Tian <kevin.tian@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agofix parameter order for flaglist()
Dongxiao Xu [Thu, 20 Jan 2011 13:02:11 +0000 (21:02 +0800)]
fix parameter order for flaglist()

(From Poky rev: 5da9423217a5cd204d17a0f7bbe248082a1b257c)

Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/providers.py: Fix runtime providers problems
Richard Purdie [Thu, 20 Jan 2011 22:44:33 +0000 (22:44 +0000)]
bitbake/providers.py: Fix runtime providers problems

Take a real world testcase where you have two recipes, each of which
contains PACKAGES_DYNAMIC = "gdk-pixbuf-loaders-*" and recipes which
RDEPEND on some gdk-pixbuf-loaders-xxx package. To select between these
you need to set a PREFERRED_PROVIDER.

These are specified in the PN namespace so the locgical conclusion is
that setting PREFERRED_PROVIDER_gdk-pixbuf = "gtk+" should work. It
doesn't and instead checks crazy things.

The code was correctly finding the two possible providers, gtk+ and
gdk-pixbuf. It was however only accepting PREFERRED_PROVIDER_gtk+
= "gdk-pixbuf" to resolve this problem which reads as the exact
opposite to what was wanted.

This patch changes the code to do something that makes sense. I suspect
that before these changes it was pretty much a null operation rubber
stamping the single provider case. For Poky at least it exposes a few
cases where -nativesdk recipes were providing the same things as their
normal counterparts but these are genuine bugs in the metadata.

I've also attempted to make the multiple provider error message human
readable as I counldn't understand it and I doubt anyone else could
either.

(From Poky rev: d4f537965b3a530ca7ed3bce206abbff810031e8)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/utils.py: Teach unlockfile about shared mode lockfiles
Richard Purdie [Wed, 19 Jan 2011 13:30:14 +0000 (13:30 +0000)]
bitbake/utils.py: Teach unlockfile about shared mode lockfiles

(From Poky rev: fd88588df029604689db9b0e30c55aad68392a5d)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/utils.py: Add option of holding shared lockfiles
Richard Purdie [Wed, 19 Jan 2011 11:01:54 +0000 (11:01 +0000)]
bitbake/utils.py: Add option of holding shared lockfiles

(From Poky rev: 7857834691868b7f48f732ee78d8770f5473ff68)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoIntroduce stamp-extra-info task flag into stamp filenames
Dongxiao Xu [Tue, 18 Jan 2011 08:18:18 +0000 (16:18 +0800)]
Introduce stamp-extra-info task flag into stamp filenames

For certain tasks, we need additional information in build stamp file
other than the task name and file name. stamp-extra-info is introduced as
a task flag which is appended to the stamp file name.

[Code simplifcations/tweaks from Richard]

(From Poky rev: 80cf3e405c923ed95dd09936739e816dbdd92299)

Signed-off-by: Dongxiao Xu <dongxiao.xu@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/build.py: Rename message field to avoid DeprecationWarning: BaseException...
Richard Purdie [Mon, 17 Jan 2011 15:52:06 +0000 (15:52 +0000)]
bitbake/build.py: Rename message field to avoid DeprecationWarning: BaseException.message warning

(From Poky rev: 0388f0758f84c7a8ec975d9be7e384cb65d9af4c)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/siggen.py: Fix whitelisted variable handling
Richard Purdie [Wed, 12 Jan 2011 15:58:48 +0000 (15:58 +0000)]
bitbake/siggen.py: Fix whitelisted variable handling

Even when a variable was whitelisted, any dependencies of that variable
could still creep into the task hash due to the way the whitelisting
code worked. This patch changes thing to ensure that when whitelisted,
that whitelisting applies to the variable and any dependencies it has.

(From Poky rev: 25b3d39612c0bea1d136e346d938abde56aa699f)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoIncrement version for development version
Richard Purdie [Fri, 18 Feb 2011 17:06:45 +0000 (17:06 +0000)]
Increment version for development version

9 years agoRelease 1.12.0 1.12.0
Richard Purdie [Fri, 18 Feb 2011 17:03:42 +0000 (17:03 +0000)]
Release 1.12.0

9 years agouihelper: import bb.build, kill commented lines
Chris Larson [Wed, 16 Feb 2011 22:58:07 +0000 (15:58 -0700)]
uihelper: import bb.build, kill commented lines

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agocooker: don't choke if we have nothing to parse
Chris Larson [Wed, 16 Feb 2011 22:50:50 +0000 (17:50 -0500)]
cooker: don't choke if we have nothing to parse

If all our recipes were cached, there's no reason to fire off any parsing
progress events at all.

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agosiggen: add bb.data, bb.parse imports
Chris Larson [Wed, 16 Feb 2011 22:41:37 +0000 (15:41 -0700)]
siggen: add bb.data, bb.parse imports

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agorunqueue: simplify RunQueueStats.copy
Chris Larson [Wed, 16 Feb 2011 22:24:24 +0000 (15:24 -0700)]
runqueue: simplify RunQueueStats.copy

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agorunqueue: pass a copy of the RunQueueStats to events
Chris Larson [Wed, 16 Feb 2011 22:18:06 +0000 (15:18 -0700)]
runqueue: pass a copy of the RunQueueStats to events

This avoids cases where the stats are modified after the event is fired but
before it's dispatched to the UI.

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agoserver: clean up call of write_profile_stats
Chris Larson [Wed, 16 Feb 2011 00:07:00 +0000 (17:07 -0700)]
server: clean up call of write_profile_stats

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agoserver: add profiling support to ProcessServer
Chris Larson [Tue, 15 Feb 2011 23:59:56 +0000 (16:59 -0700)]
server: add profiling support to ProcessServer

Based on poky's support, particularly the format of the processed log file and
the log message shown to the user regarding the files written.

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agoEnable some DeprecationWarnings
Chris Larson [Sat, 12 Feb 2011 04:26:51 +0000 (21:26 -0700)]
Enable some DeprecationWarnings

We'll be skipping the Pending Deprecation step given our release process.

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agopersist_data: handle lock in sqlite and use the shared cache
Chris Larson [Thu, 10 Feb 2011 00:56:42 +0000 (17:56 -0700)]
persist_data: handle lock in sqlite and use the shared cache

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agopersist_data: drop SQLData indirection
Chris Larson [Fri, 11 Feb 2011 16:42:38 +0000 (09:42 -0700)]
persist_data: drop SQLData indirection

The common case (if not the only case) is to only use a single domain.  The
only reason SQLData exists is to make it easier to delete a domain.  Yet,
there's no need for us to delete a domain if SQLTable knows how to clear
itself out.  So, add clear() to the table and pass the domain to persist().

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agopersist_data: use better items/values methods for SQLTable
Chris Larson [Thu, 10 Feb 2011 00:57:35 +0000 (17:57 -0700)]
persist_data: use better items/values methods for SQLTable

Signed-off-by: Chris Larson <chris_larson@mentor.com>
9 years agofetch2: Correct the clean() mechanism for the fetcher2 code
Saul Wold [Wed, 9 Feb 2011 22:30:29 +0000 (14:30 -0800)]
fetch2: Correct the clean() mechanism for the fetcher2 code

This create a clean() method in each of the fetcher modules
and correctly cleans the .done stamp file and lock files

(From Poky rev: 14dea89521c0c648e8e543388096a6dcd6d4f2e0)

Signed-off-by: Saul Wold <sgw@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2/git: Write mirror tarballs if enabled and they don't exist, also set...
Richard Purdie [Thu, 10 Feb 2011 15:14:49 +0000 (15:14 +0000)]
bitbake/fetch2/git: Write mirror tarballs if enabled and they don't exist, also set a default value for mirror tarball generation

(From Poky rev: 59a08262aba2d2b9b8b299a2818fb4cfe13b9909)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Fix negated if check for BB_FETCH_PREMIRRORONLY
Richard Purdie [Wed, 9 Feb 2011 01:23:56 +0000 (01:23 +0000)]
bitbake/fetch2: Fix negated if check for BB_FETCH_PREMIRRORONLY

(From Poky rev: 29ed2c6e9a0c3cc57c5bbaf3c53e1cff8586c51c)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agofetch2: Add SRPM knowledge
Mark Hatle [Tue, 8 Feb 2011 00:18:18 +0000 (18:18 -0600)]
fetch2: Add SRPM knowledge

Enable the fetcher to be able to unpack and SRPM.  By default the system will
unpack the contents of the SRPM into the WORKDIR.

A new syntax "unpack=file" was developed for the SRC_URI, to allow for a
recipe to extract a specific file within an SRPM.  An unpack operation will
then be executed on the extracted file.

In order to apply extracted patches (or unpack files not specified with
unpack), you must specify the path using WORKDIR, i.e.:

file://${WORKDIR}/mypatch.patch

(From Poky rev: 906285ff00d6ffd3fd7713af52250e7c6503edb7)

Signed-off-by: Mark Hatle <mark.hatle@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Ignore UnboundLocalError in exception handler in try_mirror
Richard Purdie [Tue, 8 Feb 2011 17:30:45 +0000 (17:30 +0000)]
bitbake/fetch2: Ignore UnboundLocalError in exception handler in try_mirror

(From Poky rev: aa45760702e874977454778659c205b29d1ff049)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Move symlink handling into try_mirror where is belongs instead of...
Richard Purdie [Tue, 8 Feb 2011 12:46:25 +0000 (12:46 +0000)]
bitbake/fetch2: Move symlink handling into try_mirror where is belongs instead of the main download function

(From Poky rev: ee1a9c0476cc4b2ce9dfb0faa29a1371a8517c40)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: When using BB_FETCH_PREMIRRORONLY, set BB_NO_NETWORK after premirrors...
Richard Purdie [Tue, 8 Feb 2011 12:44:06 +0000 (12:44 +0000)]
bitbake/fetch2: When using BB_FETCH_PREMIRRORONLY, set BB_NO_NETWORK after premirrors as there could be data processing needed by the real fetcher

(From Poky rev: c4e66a7fe0c314b843aac6340995c584ec156529)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Ensure we only remove files, not directories when fetch failures...
Richard Purdie [Tue, 8 Feb 2011 12:42:24 +0000 (12:42 +0000)]
bitbake/fetch2: Ensure we only remove files, not directories when fetch failures occur

(From Poky rev: 91eeb9b0d334275ff2730e55e86fd351e1b652ef)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Ensure original ud is preserved in try_mirror
Richard Purdie [Tue, 8 Feb 2011 12:40:40 +0000 (12:40 +0000)]
bitbake/fetch2: Ensure original ud is preserved in try_mirror

(From Poky rev: 0713fb6b99486cd08c6036dba7aeb15e3bfb8129)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2/git: Fix broken variable reference
Richard Purdie [Tue, 8 Feb 2011 09:33:52 +0000 (09:33 +0000)]
bitbake/fetch2/git: Fix broken variable reference

(From Poky rev: a235c67479846590eb2c7236bec3360b23c3e9b6)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2/git: Ensure unresolved branches are translated into revisions
Richard Purdie [Tue, 8 Feb 2011 09:27:59 +0000 (09:27 +0000)]
bitbake/fetch2/git: Ensure unresolved branches are translated into revisions

(From Poky rev: 5920e85c561624e657c126df58f5c378a8950bbc)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agofetch2: add try/finally to ensure lockfile is unlocked on failure
Saul Wold [Tue, 8 Feb 2011 01:29:46 +0000 (17:29 -0800)]
fetch2: add try/finally to ensure lockfile is unlocked on failure

(From Poky rev: 1544aa8ab4a80d529a001e27b473645f2caec87c)

Signed-off-by: Saul Wold <sgw@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agofetch2: add runfetchcmd to import for fetchers
Saul Wold [Mon, 7 Feb 2011 23:42:45 +0000 (15:42 -0800)]
fetch2: add runfetchcmd to import for fetchers

(From Poky rev: 232b6f3c92928c333ad1201aa8eb3706e7251cdf)

Signed-off-by: Saul Wold <sgw@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2:Fetch Make using the fn based cache optional
Richard Purdie [Mon, 7 Feb 2011 21:12:51 +0000 (21:12 +0000)]
bitbake/fetch2:Fetch Make using the fn based cache optional

(From Poky rev: 500c66337c7cb5e3044a02ef761097713e47f523)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Fix pickling issues with fetcher exceptions
Richard Purdie [Mon, 7 Feb 2011 20:46:42 +0000 (20:46 +0000)]
bitbake/fetch2: Fix pickling issues with fetcher exceptions

See the problems in http://bugs.python.org/issue1692335, need to set self.args
correctly.

(From Poky rev: d4b4b48addfa781d7b94965e0477974c3fb6dbb3)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Update mirror processing to ensure we look for mirror tarballs
Richard Purdie [Mon, 7 Feb 2011 15:28:05 +0000 (15:28 +0000)]
bitbake/fetch2: Update mirror processing to ensure we look for mirror tarballs

(From Poky rev: 94faffdaf6c13ce59987aab28383d66a9a0bf100)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Update forcefetch and mirror handling to clean up, simplfy and bug...
Richard Purdie [Mon, 7 Feb 2011 12:08:32 +0000 (12:08 +0000)]
bitbake/fetch2: Update forcefetch and mirror handling to clean up, simplfy and bug fix the code

(From Poky rev: 37624b97450f2ba3d6fad3e1e51818486451447e)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Match Fetcher log domain to that in bb.msg
Richard Purdie [Mon, 7 Feb 2011 14:46:53 +0000 (14:46 +0000)]
bitbake/fetch2: Match Fetcher log domain to that in bb.msg

(From Poky rev: ded83ffc3bd86553c9b540795660985905c925ba)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2/git: use clonedir as ud.localfile too since the mirror tarball may...
Richard Purdie [Mon, 7 Feb 2011 10:13:29 +0000 (10:13 +0000)]
bitbake/fetch2/git: use clonedir as ud.localfile too since the mirror tarball may not exist

(From Poky rev: 681bcf4e6b606dde2029d143805023a927285917)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2/git.py: Ensure that forcefetch operates in the correct directory for...
Richard Purdie [Mon, 7 Feb 2011 09:34:24 +0000 (09:34 +0000)]
bitbake/fetch2/git.py: Ensure that forcefetch operates in the correct directory for calling _contains_ref()

(From Poky rev: 330886826770ff6ec1449dc375cb4c3604b2736b)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2/git: Fix localpath to point at the clone repo since we no longer alway...
Richard Purdie [Mon, 7 Feb 2011 09:13:44 +0000 (09:13 +0000)]
bitbake/fetch2/git: Fix localpath to point at the clone repo since we no longer always generate a mirror tarball and it isn't a good guide to fetcher success

(From Poky rev: 917d3e9697acefe308e7139e86df37a072ee3500)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Use True instead of integer values
Richard Purdie [Fri, 4 Feb 2011 14:40:41 +0000 (14:40 +0000)]
bitbake/fetch2: Use True instead of integer values

(From Poky rev: 7202a77134029cb37540c785ce0161a4dd574853)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Drop name/override ordering backwards compatibility code
Richard Purdie [Fri, 4 Feb 2011 14:37:09 +0000 (14:37 +0000)]
bitbake/fetch2: Drop name/override ordering backwards compatibility code

(From Poky rev: 8f2abf4a9f000d42e98c4936e393bd5033a1af48)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2/svn: The concept of using dates with svn is totally insane, drop support
Richard Purdie [Fri, 4 Feb 2011 13:46:31 +0000 (13:46 +0000)]
bitbake/fetch2/svn: The concept of using dates with svn is totally insane, drop support

(From Poky rev: ee6f34483a9bfeca5b5c3656fd62bb4849d5fbb8)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Define a new interface to the fetcher code though the 'Fetch' class
Richard Purdie [Fri, 4 Feb 2011 13:14:03 +0000 (13:14 +0000)]
bitbake/fetch2: Define a new interface to the fetcher code though the 'Fetch' class

(From Poky rev: ca7adf75295c2a6041b891bfa61e0b4bc2f7c860)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Fix typo
Richard Purdie [Fri, 4 Feb 2011 11:06:16 +0000 (11:06 +0000)]
bitbake/fetch2: Fix typo

(From Poky rev: 08a9fef4fa0036708f29bd150d7ecf66354e5475)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake/fetch2: Drop legacy CVSDATE support
Richard Purdie [Fri, 4 Feb 2011 11:03:34 +0000 (11:03 +0000)]
bitbake/fetch2: Drop legacy CVSDATE support

(From Poky rev: 806d1c25f8ca8ab5116652e6f82f7d9ee5774278)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>