Issue 1:
Checklist

I have read the relevant section in the

contribution guide

on reporting bugs.

I have checked the issues list

for similar or identical bug reports.

I have checked the pull requests list

for existing proposed fixes.

I have checked the commit log

to find out if the bug was already fixed in the master branch.

I have included all related issues and possible duplicate issues

in this issue (If there are none, check this box anyway).

Mandatory Debugging Information

I have included the output of celery -A proj report in the issue.

(if you are not able to do this, then at least specify the Celery

version affected).

I have verified that the issue exists against the master branch of Celery.

I have included the contents of pip freeze in the issue.

I have included all the versions of all the external dependencies required

to reproduce this bug.

Optional Debugging Information

I have tried reproducing the issue on more than one Python version

and/or implementation.

I have tried reproducing the issue on more than one message broker and/or

result backend.

I have tried reproducing the issue on more than one version of the message

broker and/or result backend.

I have tried reproducing the issue on more than one operating system.

I have tried reproducing the issue on more than one workers pool.

I have tried reproducing the issue with autoscaling, retries,

ETA/Countdown & rate limits disabled.

I have tried reproducing the issue after downgrading

and/or upgrading Celery and its dependencies.

Related Issues and Possible Duplicates

Related Issues

None

Possible Duplicates

None

Environment & Settings

Celery version:

celery report Output:

celery -A celeryacl report

software -> celery:4.3.0 (rhubarb) kombu:4.5.0 py:3.6.8
billiard:3.6.0.0 py-amqp:2.4.2
platform -> system:Linux arch:64bit
kernel version:4.18.0-1013-azure imp:CPython
loader -> celery.loaders.app.AppLoader
settings -> transport:amqp results:db+mysql+pymysql://celery:**@X.X.X.X:XXXX/celeryresults

Steps to Reproduce

Required Dependencies

Minimal Python Version: N/A or Unknown

Minimal Celery Version: N/A or Unknown

Minimal Kombu Version: N/A or Unknown

Minimal Broker Version: N/A or Unknown

Minimal Result Backend Version: N/A or Unknown

Minimal OS and/or Kernel Version: N/A or Unknown

Minimal Broker Client Version: N/A or Unknown

Minimal Result Backend Client Version: N/A or Unknown

Python Packages

pip freeze Output:

pip freeze
amqp==2.4.2
asn1crypto==0.24.0
bcrypt==3.1.6
billiard==3.6.0.0
celery==4.3.0
cffi==1.12.2
Click==7.0
cryptography==2.6.1
Flask==1.0.2
Flask-Cors==3.0.7
itsdangerous==1.1.0
Jinja2==2.10
kombu==4.5.0
MarkupSafe==1.1.1
mysql-connector-python==8.0.15
netmiko==2.3.3
paramiko==2.4.2
protobuf==3.7.1
pyasn1==0.4.5
pycparser==2.19
PyMySQL==0.9.3
PyNaCl==1.3.0
pyserial==3.4
pytz==2018.9
PyYAML==5.1
scp==0.13.2
six==1.12.0
SQLAlchemy==1.2.14
textfsm==0.4.1
vine==1.3.0
Werkzeug==0.15.2

Other Dependencies

N/A

Minimally Reproducible Test Case

Expected Behavior

With the following configured "result_extended" to true I expected to see more meta data in the backend results DB but I don't. I just see the standard results.

app = Celery('tasks',

backend='db+mysql+pymysql://XXX:XXX@X.X.X.X:XXXX/celeryresults',

broker='amqp://xxxx:xxxx@X.X.X.X/celery',

result_extended=True)

Actual Behavior

Issue 2:
Checklist

I have read the relevant section in the

contribution guide

on reporting bugs.

I have checked the issues list

for similar or identical bug reports.

I have checked the pull requests list

for existing proposed fixes.

I have checked the commit log

to find out if the bug was already fixed in the master branch.

I have included all related issues and possible duplicate issues

in this issue (If there are none, check this box anyway).

Mandatory Debugging Information

I have included the output of celery -A proj report in the issue.

(if you are not able to do this, then at least specify the Celery

version affected).

I have verified that the issue exists against the master branch of Celery.

I have included the contents of pip freeze in the issue.

I have included all the versions of all the external dependencies required

to reproduce this bug.

Optional Debugging Information

I have tried reproducing the issue on more than one Python version

and/or implementation.

I have tried reproducing the issue on more than one message broker and/or

result backend.

I have tried reproducing the issue on more than one version of the message

broker and/or result backend.

I have tried reproducing the issue on more than one operating system.

I have tried reproducing the issue on more than one workers pool.

I have tried reproducing the issue with autoscaling, retries,

ETA/Countdown & rate limits disabled.

I have tried reproducing the issue after downgrading

and/or upgrading Celery and its dependencies.

Related Issues and Possible Duplicates

Related Issues

None

Possible Duplicates

None

Environment & Settings

Celery version: 4.3.0 and 4.4.0rc3

celery report Output:

/usr/local/lib/python3.6/dist-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip install psycopg2-binary" instead. For details see: <http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.
""")
Traceback (most recent call last):
File "/usr/local/bin/celery", line 11, in <module>
sys.exit(main())
File "/usr/local/lib/python3.6/dist-packages/celery/__main__.py", line 16, in main
_main()
File "/usr/local/lib/python3.6/dist-packages/celery/bin/celery.py", line 322, in main
cmd.execute_from_commandline(argv)
File "/usr/local/lib/python3.6/dist-packages/celery/bin/celery.py", line 496, in execute_from_commandline
super(CeleryCommand, self).execute_from_commandline(argv)))
File "/usr/local/lib/python3.6/dist-packages/celery/bin/base.py", line 305, in execute_from_commandline
return self.handle_argv(self.prog_name, argv[1:])
File "/usr/local/lib/python3.6/dist-packages/celery/bin/celery.py", line 488, in handle_argv
return self.execute(command, argv)
File "/usr/local/lib/python3.6/dist-packages/celery/bin/celery.py", line 420, in execute
).run_from_argv(self.prog_name, argv[1:], command=argv[0])
File "/usr/local/lib/python3.6/dist-packages/celery/bin/base.py", line 309, in run_from_argv
sys.argv if argv is None else argv, command)
File "/usr/local/lib/python3.6/dist-packages/celery/bin/base.py", line 393, in handle_argv
return self(*args, **options)
File "/usr/local/lib/python3.6/dist-packages/celery/bin/base.py", line 253, in __call__
ret = self.run(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/celery/bin/celery.py", line 371, in run
self.out(self.app.bugreport())
File "/usr/local/lib/python3.6/dist-packages/celery/bin/base.py", line 413, in out
print(s, file=fh or self.stdout)
UnicodeEncodeError: 'ascii' codec can't encode character '\xe5' in position 6271: ordinal not in range(128)

Steps to Reproduce

Required Dependencies

Minimal Python Version: 3.6.7

Minimal Celery Version: N/A or Unknown

Minimal Kombu Version: N/A or Unknown

Minimal Broker Version: N/A or Unknown

Minimal Result Backend Version: N/A or Unknown

Minimal OS and/or Kernel Version: N/A or Unknown

Minimal Broker Client Version: N/A or Unknown

Minimal Result Backend Client Version: N/A or Unknown

Python Packages

pip freeze Output:

amqp==2.5.1
asn1crypto==0.24.0
billiard==3.6.1.0
celery==4.4.0rc3
certifi==2019.6.16
chardet==3.0.4
cryptography==2.1.4
Django==2.1.12
django-celery-beat==1.5.0
django-celery-results==1.1.2
django-pyodbc-azure==2.1.0.0
django-redis==4.8.0
django-rest-auth==0.9.5
django-timezone-field==3.0
djangorestframework==3.9.4
environs==4.2.0
flower==1.0.0
humanize==0.5.1
idna==2.6
importlib-metadata==0.20
keyring==10.6.0
keyrings.alt==3.0
kombu==4.6.4
marshmallow==3.0.1
more-itertools==7.2.0
psycopg2==2.7.5
pycrypto==2.6.1
pygobject==3.26.1
pyodbc==4.0.23
python-crontab==2.3.8
python-dateutil==2.8.0
python-dotenv==0.10.3
pytz==2019.2
pyxdg==0.25
redis==3.3.0
requests==2.22.0
SecretStorage==2.3.1
six==1.11.0
sqlparse==0.3.0
tornado==6.0.3
urllib3==1.25.3
vine==1.3.0
zipp==0.6.0

Other Dependencies

N/A

Minimally Reproducible Test Case

The settings.py:

CELERY_BROKER_URL = 'amqp://crunchy:waffles@192.168.0.38//'

CELERY_RESULT_BACKEND = 'django-db'
CELERY_CACHE_BACKEND = 'django-cache'

# celery setting.
CELERY_CACHE_BACKEND = 'default'

# django setting.
CACHES = {
'default': {
'BACKEND': 'django.core.cache.backends.db.DatabaseCache',
'LOCATION': 'my_cache_table',
}
}

CELERY_BEAT_SCHEDULE = {
'mountPackages': {
'task': 'sge.tasks.mountPackages',
'schedule': crontab(),#crontab(minute='0', hour='7-22/1',day_of_week='mon-sat'), # execute every hour on day weeks from 7AM to 22PM
'options': {'queue': 'sender'}
},
'notProcessedPackages': {
'task': 'sge.tasks.notProcessedPackages',
'schedule': crontab(),#crontab(minute='30', hour='7-22/3' ,day_of_week='mon-sat'), # execute every three hours on day weeks from 7AM to 10PM
'options': {'queue': 'unused'}
},
'getNotas': {
'task': 'sge.tasks.getNotas',
'schedule': crontab(minute='50', hour='19' ,day_of_week='mon-sat'), # execute every 8PM from monday to saturdar
'options': {'queue': 'grades'}
}
}

celery.py

from __future__ import absolute_import
import os
from celery import Celery
from django.conf import settings

os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'iis.settings')

app = Celery('iis',)
app.config_from_object('django.conf:settings', namespace='CELERY',)
app.autodiscover_tasks()

Expected Behavior

The URLs on celery should be replaced by the parameters defined in the settings.py

Actual Behavior

The result URL and transport URL in the config aren't update to the URLs placed in the Django settings.py.

shell>> celery -A iis worker -Q unused -l info

-------------- celery@celery-worker-unused-6bb747fcc5-ql4w5 v4.4.0rc3 (cliffs)

---- **** -----

--- * *** * -- Linux-3.10.0-957.27.2.el7.x86_64-x86_64-with-Ubuntu-18.04-bionic 2019-09-02 15:07:10

-- * - **** ---

** ---------- [config]

** ---------- .> app: iis:0x7fc6a4802f98

** ---------- .> transport: redis://redis:6379//

** ---------- .> results: redis://redis:6379/

*** --- * --- .> concurrency: 8 (prefork)

-- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)

--- ***** -----

-------------- [queues]

.> unused exchange=unused(direct) key=unused

[tasks]

. sge.tasks.getNotas

. sge.tasks.mountPackages

. sge.tasks.notNeededPackage

. sge.tasks.notProcessedPackages

. sge.tasks.requestNotasAlunos

. sge.tasks.sendPackages

[2019-09-02 15:07:11,202: INFO/MainProcess] Connected to redis://redis:6379//

[2019-09-02 15:07:11,215: INFO/MainProcess] mingle: searching for neighbors

^C