python setup.py sdist -does not include all files under revision
 

Lukasz Szybalski wrote:
> Hello,
> I'm trying to make a release and would like to upload tar.gz file to launchpad.
> After some searching I found out that this command should get that done for me:
>
> python setup.py sdist
>
> Unfortunately it does not include all files in the package/ files
> under revision.
>
> I've installed setuptools_bzr in a hope that 'python setup.py sdist'
> would include all the folders I have included in my package.

I've never used setuptools_bzr, but my personal recommendation is to
manually create your MANIFEST.in file... you probably don't want always
to include everything under version control in your sdist package. Often
times you will have certain scripts and whatnot that are handy from
within the checkout, but just don't make sense to include in the sdist
package.

For what it's worth, I've been working on a tool to make it super easy
to go from the bzr branch of a Python project (packaged using
setuptools) to a Debian/Ubuntu package, including building under
pbuilder and uploading to your PPA. For the past 5 months I've been too
busy with my day job to really work on it, but prior to that I made a
decent start. It's called bzr-release:

https://launchpad.net/bzr-release

It's self-hosting so it is itself a good example of how to use it, plus
I have two other projects using it:

https://launchpad.net/pyawesome

https://launchpad.net/snakebite

Please let me know if you happen to be interested in testing/developing
bzr-release... I'm sure some outside interest would help guilt/inspire
me to work on it more. ;)

Best of luck!

Cheers,
Jason DeRose

> Unfortunately that is not the case.
>
> If I go back to the some previous version that is till in svn then it
> seems to work correctly and include every file.
>
> Any ideas how can I make this work with bzr -> launchpad.
>
> Thanks,
>
>
> python setup.py sdist
> running sdist
> running egg_info
> writing requirements to datahub.egg-info/requires.txt
> writing datahub.egg-info/PKG-INFO
> writing top-level names to datahub.egg-info/top_level.txt
> writing dependency_links to datahub.egg-info/dependency_links.txt
> writing entry points to datahub.egg-info/entry_points.txt
> writing manifest file 'datahub.egg-info/SOURCES.txt'
> warning: sdist: standard file not found: should have one of README, README.txt
> creating datahub-0.7dev
> creating datahub-0.7dev/datahub
> creating datahub-0.7dev/datahub.egg-info
> making hard links in datahub-0.7dev...
> hard linking setup.cfg -> datahub-0.7dev
> hard linking setup.py -> datahub-0.7dev
> hard linking datahub/__init__.py -> datahub-0.7dev/datahub
> hard linking datahub.egg-info/PKG-INFO -> datahub-0.7dev/datahub.egg-info
> hard linking datahub.egg-info/SOURCES.txt -> datahub-0.7dev/datahub.egg-info
> hard linking datahub.egg-info/dependency_links.txt ->
> datahub-0.7dev/datahub.egg-info
> hard linking datahub.egg-info/entry_points.txt ->
> datahub-0.7dev/datahub.egg-info
> hard linking datahub.egg-info/not-zip-safe -> datahub-0.7dev/datahub.egg-info
> hard linking datahub.egg-info/requires.txt -> datahub-0.7dev/datahub.egg-info
> hard linking datahub.egg-info/top_level.txt -> datahub-0.7dev/datahub.egg-info
> copying setup.cfg -> datahub-0.7dev
> Writing datahub-0.7dev/setup.cfg
> tar -cf dist/datahub-0.7dev.tar datahub-0.7dev
> gzip -f9 dist/datahub-0.7dev.tar
> removing 'datahub-0.7dev' (and everything under it)
>
>
>
>

--
launchpad-users mailing list
launchpad-users@lists.canonical.com
Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/launchpad-users

python setup.py sdist -does not include all files under revision
 

Hello Lukasz,

Lukasz Szybalski [2008-11-26 19:21 -0600]:
> python setup.py sdist
>
> Unfortunately it does not include all files in the package/ files
> under revision.

No idea about setuptools_bzr, but Jason already replied to that.

FWIW, I also maintain my own MANIFEST.in, since my project (jockey) creates
some autogenerated files which need to go into the source, too, and doesn't
ship everything in bzr. My "do-release" script has this rule to check that I
didn't forget anything:

# check manifest
./setup.py build
./setup.py sdist -o
./setup.py clean -a
missing=$(for f in `find -type f ! -path '*.bzr*' ! -name '.coverage' ! -name 'MANIFEST*' ! -name do-release ! -name TODO`; do grep -qFx "${f#./}" < MANIFEST || echo $f; done)
if [ -n "$missing" ]; then
echo "MANIFEST is missing the following files:"
echo "$missing"
exit 1;
fi

So for every new file I either need to add it to the find blacklist,
or to MANIFEST.in.

Maybe it helps anyone.

Martin

--
Martin Pitt | http://www.piware.de
Ubuntu Developer (www.ubuntu.com) | Debian Developer (www.debian.org)

--
launchpad-users mailing list
launchpad-users@lists.canonical.com
Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/launchpad-users

python setup.py sdist -does not include all files under revision
 

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Nov 27, 2008, at 3:32 AM, Martin Pitt wrote:
>
> Lukasz Szybalski [2008-11-26 19:21 -0600]:
>> python setup.py sdist
>>
>> Unfortunately it does not include all files in the package/ files
>> under revision.
>
> No idea about setuptools_bzr, but Jason already replied to that.

Sorry, I have not been following this thread. If you find bugs in
setuptools_bzr, please report them here:

https://bugs.launchpad.net/setuptoolsbzr

and I'll do my best to fix them. I use it in my own projects, so I'm
keen on making sure it works properly.

- -Barry

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Darwin)

iEYEARECAAYFAkkurwUACgkQ2YZpQepbvXFT4QCcCK7Q7xQCwT OBT4eBn/FwlU0G
SlcAoJ6rU0Lig10og3VGU9nos/BNvQON
=btAT
-----END PGP SIGNATURE-----

--
launchpad-users mailing list
launchpad-users@lists.canonical.com
Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/launchpad-users

python setup.py sdist -does not include all files under revision
 

On Thu, Nov 27, 2008 at 8:30 AM, Barry Warsaw <barry@canonical.com> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> On Nov 27, 2008, at 3:32 AM, Martin Pitt wrote:
>>
>> Lukasz Szybalski [2008-11-26 19:21 -0600]:
>>> python setup.py sdist
>>>
>>> Unfortunately it does not include all files in the package/ files
>>> under revision.
>>
>> No idea about setuptools_bzr, but Jason already replied to that.
>
> Sorry, I have not been following this thread. If you find bugs in
> setuptools_bzr, please report them here:
>
> https://bugs.launchpad.net/setuptoolsbzr
>
> and I'll do my best to fix them. I use it in my own projects, so I'm
> keen on making sure it works properly.
>

So I search some of the old emails and I found that setuptools reads
.svn stuff if they are there and that is how it knows what to include.
This doesn't seem to work with setuptoolsbzr, I've added a tickiet.

As far as keeping a manifest.in, that seems like a lot of work? What
would be a command on setup.py that would run "put all the files in
manifest.in" and then I could take out what I don't want. Currently I
want all the files in, things change a lot so keeping track manually
would not be an option.

Thanks,
Lucas

--
launchpad-users mailing list
launchpad-users@lists.canonical.com
Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/launchpad-users

python setup.py sdist -does not include all files under revision
 

Your MANIFEST.in could look like this:

recursive-include *
prune not-this-file.htm
prunt or-this-one.txt
Jacob Peddicord
http://jacob.peddicord.net

jpeddicord@ubuntu.com
jacob@fosswire.com



On Fri, Nov 28, 2008 at 9:55 AM, Lukasz Szybalski <szybalski@gmail.com> wrote:

On Thu, Nov 27, 2008 at 8:30 AM, Barry Warsaw <barry@canonical.com> wrote:

> -----BEGIN PGP SIGNED MESSAGE-----

> Hash: SHA1

>

> On Nov 27, 2008, at 3:32 AM, Martin Pitt wrote:

>>

>> Lukasz Szybalski [2008-11-26 19:21 -0600]:

>>> python setup.py sdist

>>>

>>> Unfortunately it does not include all files in the package/ files

>>> under revision.

>>

>> No idea about setuptools_bzr, but Jason already replied to that.

>

> Sorry, I have not been following this thread. *If you find bugs in

> setuptools_bzr, please report them here:

>

> https://bugs.launchpad.net/setuptoolsbzr

>

> and I'll do my best to fix them. *I use it in my own projects, so I'm

> keen on making sure it works properly.

>



So I search some of the old emails and I found that setuptools reads

.svn stuff if they are there and that is how it knows what to include.

This doesn't seem to work with setuptoolsbzr, I've added a tickiet.



As far as keeping a manifest.in, that seems like a lot of work? What

would be a command on setup.py that would run "put all the files in

manifest.in" and then I could take out what I don't want. Currently I

want all the files in, things change a lot so keeping track manually

would not be an option.



Thanks,

Lucas



--

launchpad-users mailing list

launchpad-users@lists.canonical.com

Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/launchpad-users



--
launchpad-users mailing list
launchpad-users@lists.canonical.com
Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/launchpad-users